5 


MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  OF  STANDARDS- I963-A 


REPORT  R-945 


JULY  1 1982 


UILU-ENG  82-2211 


T-'  rnn  r>> 

■+S  KmJf  V-'  *'  rf  ibUf  i 


a  i 


“LECTE 
mar  2  1 1383 

A 


CODING  FOR  FREQUENCY  *  HOPPED 
SPREAD-SPECTRUM  CHANNELS  WITH 
PARTIAL-BAND  INTERFERENCE 


uN CLASSIC  icD 


SECURITY  CLASSIFICATION  OF  THIS  PAOE  (*ben  Dote  Knitted) 


REPORT  DOCUMENTATION  PAGE 


REPORT  NUMBER 


4.  TITLK  (end  Subtitle) 

CODING  FOR  FREQUENCY-HOPPED  SPREAD-SPECTRUM 
CHANNELS  WITH  PARTIAL-BAND  INTERFERENCE 


7.  MJTHO*f«A 


Wayne  Eric  Stark 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


3.  RECIPIENT'S  CATALOG  NUMBER 


S.  TYRK  OF  REPORT  *  FCRIOO  COVERED 

Technical  Report 


S.  PERFORMING  ORO.  RKRORT  NUMBER 

R-945;  UILU-ENG  82-2211 


S.  CONTRACT  OR  ORAnT  NUMBERfa; 

N00014-79-C-0424 


».  PERFORMING  ORGANIZATION  NAMK  ANO  ADDRESS 

Coordinated  Science  Laboratory 

1101  W.  Springfield  Avenue 

University  of  Illinois  at  Urbana-Champaign 

ITr-Kana  TT  AtSfLI _  _ 1 _ ? _ 


It.  CONTROLLING  OFFICE  NAME  AND  AOORESS 

Joint  Services  Electronics  Program 


4.  MONITORING  AGENCY  NAME  A  AOORESV/I  dllletent  tram  Controlling  Otlico) 


10.  PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  *  WORK  UNIT  NUMBERS 


13.  NUMBER  OF  PAGES 

135  _ 


IS.  SECURITY  CLASS,  (ol  Chit  import) 


UNCLASSIFIED 


15a.  OECLASSIFICATION/ DOWNGRADING 
SCHEDULE 


IS.  DISTRIBUTION  STATEMENT  (ol  Chit  Report; 

Approved  for  public  release;  distribution  unlimited 


17.  DISTRIBUTION  STATEMENT  (ol  thm  tbttrtel  entered  In  Block  20,  II  dlllerent  tram  Report; 


13.  KEY  WOROS  (Contlnut  on  reverie  tide  II  neceeeery  end  Identity  by  block  number) 


20.  ABSTRACT  ( Continue  on  reverie  ride  II  neceeeery  end  Identity  by  block  numoer) 

The  performance  of  codes  on  frequency-hopped  spread-spectrum  channels  with 
partial-band  interference  is  investigated.  The  asymptotic  performance  of  codes 
is  measured  by  the  channel  capacity  and  the  random  coding  exponent.  The 
performance  of  specific  codes  is  measured  by  the  bit  error  probability.  The 
cnannel  models  we  consider  are  quite  general  and  include  channels  with  unknown 
parameters,  channels  which  change  with  time,  and  channels  with  raemorv.  These 
models  are  applicable  to  frequency-hopped  spread-spectrum  communication  svstems 
as  well  as  to  several  other  communication  svstems. 


00  ,  ;^J  1473 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  Ce  This  RAGE  When  Dele  Surreal 

"V 


«*dU*lTV  CLASSIFICATION  OF  THIS  PAOlfWIlM  Ota  tmma) _ 


\  We  formulate  the  problem  of  comm8nicatlng  over  channels  with  unknown 
transition  probabilities  (i.e.  communicating  over  channels  with  jamming)  as  a 
game  theory  problem  with  payoff  function  being  the  mutual  information  between 
the  channel  input  and  the  channel  output.  Under  certain  restrictions  it  is 
shown  that  memoryless  coding  and  jamming  strategies  are  simultaneously  optimal 
strategies.  Next  we  develop  simple,  yet  accurate,  models  for  many  channels  with 
memory  that  arise  in  practice.  The  channel  statistics  are  constant  for  blocks 
of  symbols  of  fixed  length.  The  receiver  is  said  to  have  side  information  if 
it  can  determine  the  channel  statistics  for  each  block  of  symbols  transmitted. 

We  determine  the  capacity,  cutoff  rate,  and  random  coding  exponent  for  these 
channels.  The  capacity  without  side  information  is  an  increasing  function  of 
the  memory  length  while  the  cutoff  rate  is  a  decreasing  function  of  the  memory 
length.  We  show  that,  for  channels  with  memory  and  side  information  random- 
error  correcting  codes  with  interleaving  and  burst-error  correcting  codes  have 
comparable  performance,  while  for  channels  without  side  information  random- 
error  correcting  codes  with  interleaving  are  inferior  to  burst-error  correcting 
codes.  As  a  particular  example,  we  examine  the  performance  of  several  forms  of 
modulation  and  demodulation  with  partial -band  jamming.  Our  conclusion  is  that 
partial-band  jammers  can  be  neutralized  provided  we  use  codes  with  rate  less 
than  a  constant  that  depends  on  the  form  of  modulation  and  demodulation. 


UNCLASSIFIED 


CODING  FOR  FREQUENCY-HOPPED  SPREAD -SPECTRUM 


CHANNELS  WITH  PARTIAL-BAND  INTERFERENCE 

Wayne  Eric  Stark,  Ph.D. 

Department  of  Electrical  Engineering 
University  of  Illinois  at  Urbana-Champaign ,1982 

ABSTRACT 

The  performance  of  codes  on  frequency-hopped  spread-spectrum 
channels  with  partial-band  Interference  is  investigated.  The  asymptotic 
performance  of  codes  is  measured  by  the  channel  capacity  and  the  random 
coding  exponent.  The  performance  of  specific  codes  is  measured  by  the 
bit  error  probability.  The  channel  models  we  consider  are  quite  general 
and  include  channels  with  unknown  parameters,  channels  which  change  with 
time,  and  channels  with  memory.  These  models  are  applicable  to 
frequency-hopped  spread-spectrum  communication  systems  as  well  as  to 
several  other  communication  systems. 

We  formulate  the  problem  of  communicating  over  channels  with 
unknown  transition  probabilities  (i.e.  communicating  over  channels  with 
jamming)  as  a  game  theory  problem  with  payoff  function  being  the  mutual 
information  between  the  channel  input  and  the  channel  output.  Under 
certain  restrictions  it  is  shown  that  memoryless  coding  and  jamming 
strategies  are  simultaneously  optimal  strategies.  Next  we  develop 
simple,  yet  accurate,  models  for  many  channels  with  memory  that  arise  in 
practice.  The  channel  statistics  are  constant  for  blocks  of  symbols  of 
fixed  length.  The  receiver  is  said  to  have  side  information  if  it  can 


determine  the  ch»nn« 1  statistics  for  each  block  of  symbols  transmitted. 
Ve  determine  the  capacity,  cutoff  rate,  and  random  coding  exponent  for 
these  channels.  The  capacity  without  side  information  is  an  increasing 
function  of  the  memory  length  while  the  cutoff  rate  is  a  decreasing 
function  of  the  memory  length.  We  show  that,  for  channels  with  memory 
and  side  information  random-error  correcting  codes  with  interleaving  and 
burst-error  correcting  codes  have  comparable  performance,  while  for 
channels  without  side  information  random-error  correcting  codes  with 
interleaving  are  inferior  to  burst-error  correcting  codes.  As  a 
particular  example,  we  examine  the  performance  of  several  forms  of 
modulation  and  demodulation  with  partial-band  jamming.  Our  conclusion 
is  that  parti*vl-band  jammers  can  be  nuetralized  provide  we  use  codes 
with  rate  less  than  a  constant  that  depends  of  the  form  of  modulation 


and  demodulation. 


CODING  FOR  FREQUENCY-HOPPED  SPREAD-SPECTRUM 


CHANNELS  WITH  PARTIAL-BAND  INTERFERENCE 


BY 

WAYNE  ERIC  STARK 

B.S.,  University  of  Illinois,  1978 
M.S.,  University  of  Illinois,  1979 


THESIS 

Submitted  in  partial  fulfillment  of  the  requirements 
for  the  degree  of  Doctor  of  Philosophy  in  Electrical  Engineering 
in  the  Graduate  College  of  the 
University  of  Illinois  at  Urbana-Champaign,  1982 


Urbana,  Illinois 


iii 


ACKNOWLEDGEMENT 

I  would  like  to  thank  Professor  Robert  J.  McEliece,  my  thesis  advisor, 
for  his  stimulation  and  encouragement  throughout  the  course  of  this  work. 

I  am  also  grateful  to  Professors  M.  B.  Pursley  and  D.  V.  Sarwate  for  many 
enlightening  discussions  and  to  Professor  D.  V.  Sarwate  for  serving  as 
chairman  of  the  doctoral  committee.  „ Thanks  are  due  also  to  Professor 
T.  Basar  for  serving  on  the  committee  and  for  proof  reading  the  thesis. 
Finally,  I  would  like  to  thank  Mrs.  Phyllis  Young  for  her  speedy  and  expert 


typing. 


iv 

TABLE  OF  CONTENTS 

Page 

CHAPTER  1.  INTRODUCTION  .  1 

CHAPTER  2.  INFORMATION  THEORETIC  MODELS .  7 

'  2.1  Introduction .  7 

2.2  Game  Theory  Formulation .  9 

2.3  Information  Theoretic  Interpretation .  15 

2.4  Channels  with  Memory . 17 

'2.5  Channels  with  Memory  and  Jamming .  26 

2.6  Performance  of  Codes  on  Channels  with  Memory .  29 

CHAPTER  3.  CODING  FOR  CHANNELS  WITH  PARTIAL-BAND  JAMMING 

AND  COHERENT  DEMODULATION .  35 

3.1  Introduction . 35 

3.2  Channel  Models .  35 

3.3  Channel  Capacity .  41 

3.4  Channel  Cutoff  Rate .  55 

3.5  Performance  of  Codes .  60 

CHAPTER  4.  CODING  FOR  CHANNELS  WITH  PARTIAL-BAND  JAMMING 

AND  NONCOHERENT  DEMODULATION .  86 

4.1  Introduction.... .  86 

4.2  Channel  Models .  87 

4.3  Channel  Capacity .  90 

4.4  Channel  Cutoff  Rate .  102 

4.5  Performance  of  Codes . 109 

CHAPTER  5.  SUMMARY  AND  CONCLUSIONS .  116 

APPENDIX  A.  DERIVATION  OF  CAPACITY,  RANDOM  CODING  EXPONENT, 

AND  CUTOFF  RATE  FOR  CHANNELS  WITH  MEMORY .  118 

APPENDIX  B.  WORST  CASE  DISTRIBUTION  FOR  PARTIAL-BAND  JAMMING .  122 

APPENDIX  C.  ERROR  PROBABILITY  FOR  REPETITION  CODES  ON 

M-ARY  SYMMETRIC  CHANNELS .  126 

REFERENCES .  131 


VITA 


135 


1 


CHAPTER  1 
INTRODUCTION 

In  many  communication  systems  the  noise  present  is  not  entirely  due  to 
thermal  noise  in  the  receiver.  Many  communication  systems  must  operate  in 
the  presence  of  interference  or  noise  from  other  sources.  For  reliable 
communication,  these  systems  must  be  designed  to  perform  acceptably  even  in 
the  presence  of  interference.  Often  very  little  information  is  known  about 
the  particular  form  of  the  interference.  It  could  be  that  the  power  of  the 
interfering  signal  is  known  or  is  known  to  be  less  than  some  number  but 
little  other  information  is  given  on  the  structure  of  the  interference.  For 
such  situations  the  communication  system  must  be  robust  to  the  particular  form 
of  the  interference. 

In  many  applications  there  is  the  possibility  that  the  communication 
system  must  operate. when  there  is  a  hostile  source  of  interference  (called  a 
jammer)  which  tries  to  make  the  performance  as  unreliable  as  possible.  One  way 
to  combat  this  type  of  hostile  interference  is  through  the  use  of  spread- 
spectrum  modulation.  If  the  power  of  the  interference  is  concentrated  in  a 
certain  frequency  band  then  if  the  transmitter  uses  more  bandwidth  than  is 
necessary  for  reliable  communication  in  the  presence  of  thermal  noise  only, 
this  interference  will  have  less  of  an  effect  on  the  output  of  the  receiver. 

This  is  due  to  the  fact  that  the  interference  now  is  occupying  a  smaller 
fraction  of  the  frequency  band  being  used  by  the  transmitter-receiver. 

There  are  many  forms  of  spread-spectrum  (SS)  modulation  that  can  be 
presently  implemented.  One  form  of  SS  is  direct-sequence  [11].  Direct-sequence 
spread-spectrum  modulation  uses  signals  with  a  particular  structure  in  order 
to  minimize  the  effect  of  certain  types  of  interference.  Another  form  of 


spread-spectrum  is  frequency-hopped  spread  spectrum  Ill], [39].  This  form  of 
SS  changes  its  carrier  frequency  according  to  a  specified  hopping  pattern  and 
then  reverses  this  operation  at  the  receiver.  Only  interference  at  the  same 
frequency  of  the  transmitted  signal  affects  the  performance  of  the  system.  All 
other  interference  is  rejected  by  filters  in  the  frequency  dehopper.  A  third 
form  of  spread-spectrum  modulation  is  chirp  SS  [11], [39].  The  idea  behind  this 
form  of  modulation  is  to  continuously  change  the  instantaneous  frequency  of  the 
signal  so  that  interference  at  a  particular  frequency  affects  the  output  only  a 
fraction  of  the  time.  There  are  other  forms  of  spread-spectrum  modulation. 

A  combination  of  two  or  more  of  the  above  modulation  forms  is  also  possible  and 
should  be  considered  as  a  possible  SS  modulation.  The  different  forms  of 
spread-spectrum  modulation  have  different  characteristics.  One  type  of  SS 
modulation  might  yield  reliable  communication  for  one  type  of  interference 
whereas  another  modulation  performs  poorly  for  the  same  interference. 

In  this  thesis  we  will  consider  frequency -hopped  (FH)  spread-spectrum 
communications  subject  to  interference  that  is  in  only  a  fraction  of  the 
total  spread  bandwidth  the  transmitter  is  using.  There  are  many  systems 
that  have  this  type  of  interference.  The  prime  example  of  this  is  a 
communication  system  with  a  partial-band  jammer.  This  type  of  jammer  con¬ 
centrates  all  the  available  power  in  only  a  fraction  of  the  spread  bandwidth 
of  the  transmitter.  Interference  in  a  fraction  of  the  band  arises  also  in 
a  spread-spectrum  multiple-access  communication  system  with  different  users 
using  different  hopping  patterns.  Interference  occurs  when  two  users  hop  to 
the  same  frequency  at  the  same  time.  Yet  another  situation  which  gives  rise 
to  partial-band  interference  is  when  there  is  some  fading  of  the  transmitted 
signal  in  certain  frequency  bands.  Then  with  FH  SS  modulation  we  have  fading 


in  certain  frequency  bands  and  no  fading  in  other  frequency  bands.  Although 
we  are  considering  frequency-hopped  spread-spectrum  modulation  the  models 
developed  are  applicable  to  other  forms  of  modulation  with  different  inter¬ 
ference.  For  example  if  we  use  direct-sequence  modulation  and  the  interference 
is  a  partial-time  jammer  (pulsed-jammer)  then  the  models  for  this  ty  ■>  of 
modulation  and  interference  are  exactly  the  same  as  frequency-hoppe  pread- 
spectrum  with  partial -band  jamming. 

The  effect  of  partial-band  jamming  on  the  average  error  probab.  , 
can  be  easily  determined  with  frequency-hopped  spread-spectrum  communications. 
Consider  a  jammer  that  adds  noise  to  the  transmitted  signal  in  only  a  fraction 
of  the  frequency  band  being  used.  If  the  total  power  of  the  jammer  is  held 
fixed,  then  in  a  fraction  of  the  band, the  noise  power  density  is  larger  than 
if  the  jammer  was  spreading  his  power  over  the  entire  frequency  band.  As  a 
result  the  signal-t.o-noise  ratio  in  the  fraction  of  the  band  jammed  is 
reduced  by  a  factor  corresponding  to  the  fraction  of  the  band  jammed.  Since 
there  is  no  jamming  noise  in  the  fraction  of  the  band  that  is  not  jammed  the 
signal-to-noise  ratio  is  very  large.  When  the  jammer  chooses  to  corrupt  the 
entire  frequency  band  the  error  probability  is  typically  an  exponentially 
decreasing  function  of  the  signal-to-noise  ratio.  When  the  jammer  chooses  the 
fraction  of  the  band  to  jam  in  an  optimal  way  then  the  probability  is  an  inverse 
linear  function  of  the  average  signal-to-noise  ratio.  The  degradation  due  to 
intelligent  jamming  is  a  severe  penalty  to  be  paid  in  terms  of  performance 
(as  much  as  30-40  dB  increase  in  necessary  power  for  the  same  error  rate)  . 
Methods  that  can  reduce  the  loss  due  to  intelligent  jamming  must  be  considered- 


For  communication  systems  with  intelligent  jamming  spread-spectrum 
alone  is  insufficient  to  provide  adequate  performance.  In  this  thesis 
we  prove  that  indeed  this  loss  can  be  entirely  eliminated  by  suitable  coding 
techniques  combined  with  spread-spectrum  modulation. 

There  are  several  key  issues  that  arise  when  considering  coding  with 
spread-spectrum  communications  in  the  presence  of  partial-band  interference. 

One  key  issue  is  whether  or  not  the  decoder  knows  if  the  received  signal  has 
been  jammed  or  not.  Naturally  knowing  this  side  information  and  using  this 
in  a  clever  way  in  the  decoder  can  improve  the  performance  compared  to  coding 
without  side  information.  Another  issue  which  must  be  addressed  is  that  of 
interleaving.  The  interference  in  a  spread-spectrum  communication  system  may 
have  memory.  In  this  case  there  are  two  options  with  coding:  inter¬ 
leave  and  use  random  error  correcting  codes  or  use  burst  correcting  codes. 
Previous  work  in  coding  has  mostly  been  in  evaluating  the  performance  of 
specific  random  error  correcting  codes  on  these  channels  [18],  [21],  [31], 

[41],  [44]  or  in  computing  the  computational  cutoff  rate  for  these  channels 
[2],  [4],  [8],  [42],  [43].  All  of  the  papers  on  coding  considered  full 
interleaving  to  eliminate  the  channel  memory  used  random  error  correcting 
codes.  In  [7]  the  degradation  due  to  partial  interleaving  with 
random  error  correcting  codes  was  considered.  The  papers  on  the  channel  cutoff 
rate  have  also  considered  the  degradation  of  partial  interleaving  when  using 
random  error  correcting  codes. 

In  this  thesis  we  consider  the  performance  of  channels  with  partial-band 
interference  from  several  viewpoints.  In  Chapter  2  we  start  by  considering 
a  game  theoretic  approach  to  communication  in  the  presence  of  interference 
which  henceforth  we  shall  refer  to  as  jamming.  The  payoff  function  is  taken 


co  be  Che  mutual  information  becween  the  inpuC  of  Che  channel  and  Che  ouCpuC 
of  che  channel.  We  show  that,  under  cercain  resCricCions  on  Che  allowable 
sCracegies  che  jammer  and  coder  may  have,  che  optimal  strategies  are  to 
be  memoryless;  i.e.  memoryless  coding  and  jamming  are  the  optimal  strategies 
for  the  coder  and  jammer.  The  payoff  function  is  chosen  to  be  the  mutual 
information  for  the  following  reason.  It  can  be  shown  that  codes  and  a 
decoding  rule  exist  such  that  reliable  communication  is  possible  for  any 
allowable  strategy  of  the  jammer  provided  the  code  rate  is  less  than  the 
value  of  the  game  with  mutual  information  as  the  payoff  function.  Although 
memoryless  jamming  is  optimal,  many  situations  arise  in  which  the  jamming 
signal  has  memory.  A  model  is  presented  in  Chapter  2  which  takes  into  account 
the  possibility  of  partial-band  jamming  and  memory.  This  model  is  simple 
enough  to  be  mathematically  tractable  and  yet  gives  an  accurate  description 
of  the  channel  behavior.  This  model  highlights  the  combined  effect  of  channel 
memory  and  side  information  at  the  receiver  concerning  the  presence  of  a 
jammer.  The  basic  feature  of  the  model  is  the  block  nature  of  che  memory. 

This  is  perhaps  the  main  feature  of  frequency-hopped  spread-spectrum  communica¬ 
tion.  With  FH  SS  in  many  cases  the  interference  at  different  frequencies  are 
statistically  independent  so  that  the  channel  is  in  fact  a  memoryless  channel 
from  hop  to  hop.  We  conclude  that  when  side  information  is  available 
interleaving  does  not  degrade  the  performance , but  without  side  information 
available  the  channel  capacity  is  decreased  with  interleaving.  Also  in  Chapter 
2  we  take  a  particular  example  and  evaluate  the  performance  of  random  error 
correcting  codes  and  burst  error  correcting  codes  on  channels  with  and  without 
side  information  (with  full  interleaving  for  the  random  error  correcting  code) 
to  verify  the  conclusions  obtained  from  capacity  considerations. 


In  Chapters  3  and  4  we  consider  channels  with  a  particular  form  of 
demodulation.  Chapter  3  treats  the  case  of  coherent  demodulation  and  in 
Chapter  4  noncoherent  demodulation  is  considered.  In  both  chapters  we 
consider  the  channel  capacity,  cutoff  rate  and  coded  error  probability  of 
frequency-hopped  spread-spectrum  communications  in  the  presence  of  partial-band 
jamming.  We  consider  channels  with  memory  with  and  without  side  information 
available.  From  capacity,  cutoff  rate  and  coded  error  probability  we  conclude 
that  provided  codes  with  small  enough  rate  are  used, the  optimal  strategy  of 
the  jammer  is  to  jam  the  entire  band  so  that  the  loss  incurred  from  intelligent 
jamming  is  in  fact  completely  recovered  by  coding  with  small  rates.  This  is 
true  with  and  without  side  information  available.  Also  it  is  shown  that  in 
many  cases  there  exists  an  optimal  code  rate  that  the  coder  wishes  to  use  in 
order  to  minimize  the  energy  needed  to  transmit  any  symbol  reliably.  Various 
coding  schemes  are  calculated  for  cases  of  side  information  available  and 
interleaving  also. 

In  Chapter  5  we  make  some  comparisons  between  various  coding  strategies 
and  draw  some  conclusions  concerning  coding  for  channels  with  partial-band 


interference . 


CHAPTER  2 


INFORMATION  THEORETIC  MODELS 

2.1  Introduction 

In  this  chapter  we  take  an  information  theoretic  viewpoint  of 
frequency-hopped  spread-spectrum  channels.  The  models  we  consider  are 
general  enough  to  include  several  forms  of  interference  including  partial- 
band  jamming,  nonselective  fading,  and  multiple  access  interference.  The 
basic  feature  of  frequency-hopped  spread-spectrum  communication  is  the 
ability  of  the  transmitter  to  change  the  frequency  of  the  signal  transmitted. 
The  assumption  we  make  in  describing  the  models  is  that  when  the  frequency 
changes  the  interference  at  the  new  frequency  is  independent  of  the  inter¬ 
ference  at  all  previous  frequencies.  The  channel  accepts  symbols  from  an 
input  alphabet  A  and  produces  symbols  in  an  output  alphabet  B.  The  input 
symbols  are  partitioned  into  blocks  of  length  n.  Each  block  of  n  symbols 
is  transmitted  at  a  particular  frequency  chosen  according  to  a  hopping 
pattern.  Since  the  interference  at  a  particular  frequency  is  independent 
of  the  interference  at  other  frequencies  two  symbols  in  different  blocks 
are  affected  by  the  interference  independently.  This  is  not  necessarily 
true  for  two  symbols  in  the  same  block  of  n  symbols.  Because  of  this  the 
channel  is  not  memoryless.  Consider  now  the  new  channel  with  input  alphabet 
An  and  output  alphabet  Bn.  The  new  channel  has  as  input  symbols  a  single 
block  of  n  symbols  from  the  alphabet  A.  The  output  symbols  are  blocks  of 
n  symbols  from  the  output  alphabet  B.  Since  two  blocks  of  n  symbols  are 
transmitted  at  different  frequencies  and  are  affected  independently,  the  new 
channel  is  a  memoryless  channel.  We  make  the  following  definition  for  any 
channel.  We  say  a  channel  is  block  n  aemoryless  if  the  new  channel  which  has 


as  symbols  blocks  of  n  symbols  from  the  original  channel  is  a  memory less 
channel.  Block  1  memoryless  is  memory less  in  the  usual  sense  [27].  It  is 
important  to  point  out  that  the  transmitter  knows  which  n  symbols  constitute 
a  block  and  are  transmitted  at  a  particular  frequency  since  this  will  be 
crucial  in  the  analysis  to  follow.  Thus  frequency  hopping  with  n  bits  per 
hop  and  interference  which  is  independent  at  different  frequencies  forms  a 
block  n  memoryless  channel. 

In  this  chapter  we  consider  block  n  memoryless  channels  from  an 
information  theoretic  viewpoint.  In  Section  2.2  we  consider  a  game  theory 
formulation  for  block  n  memoryless  channels  and  determine  the  worst  block 
n  memoryless  channel  and  the  optimal  coding  strategy.  The  game  theory 
approach  uses  the  mutual  information  between  the  channel  input  and  output 
as  the  payoff  function.  This  is  justified  in  Section  2.3  where  we  state 
coding  theorems  to  show  existence  of  codes  with  rates  less  than  the  value 
of  the  game  and  with  arbitrarily  small  error  probability.  In  Section  2.4 
we  consider  a  particular  type  of  block  n  memoryless  channels.  These  channels 
are  block-1  memoryless  when  conditioned  on  an  external  random  variable  that 
typically  describes  the  level  of  noise  in  a  particular  block.  Capacity, 
cutoff  rate,  and  the  reliability  function  are  determined  for  these  channels. 
Channels  with  both  memory  and  jamming  are  considered  in  Section  2.5.  Finally, 
in  Section  2.6  we  consider  the  performance  of  specific  codes  on  channels 
with  memory.  We  consider  Reed-Solomon  codes  which  have  code  symbols  as  blocks 
of  n  symbols.  The  performance  of  convolutional  codes  with  interleaving  is  also 
determined.  We  compute  the  performance  of  these  codes  on  channel  with  and 
without  side  information  at  the  decoder  and  conclusions  are  drawn  that 
coincide  with  conclusions  from  capacity  considerations. 
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2.2  Game  Theory  Formulation 

The  communication  channel  we  consider  has  input  alphabet  A  and  output 
alphabet  B.  Flayer  I  called  the  coder,  wishes  to  communicate  information 
through  the  channel  reliably  with  largest  possible  rate.  Flayer  II ,  called 
the  jammer, wants  to  minimize  the  rate  at  which  information  can  be  trans¬ 
mitted  through  the  channel.  The  channel  is  described  by  specifying  two 
random  variables,  X  and  Y.  The  random  variable  X  is  the  input  to  the  channel 
from  the  coder  and  the  random  variable  Y  is  the  output  of  the  channel.  The 
coder's  strategies  are  distributions  Fv  on  the  random  variable  X  while  the 
jammer's  strategies  are  the  distributions  G^.(y|a)  on  the  output  of  the 
channel  when  X  =  a  is  the  input.  The  jammer  thus  chooses  the  conditional 
probabilities  of  the  output  given  the  input  while  the  coder  chooses  the 
distribution  of  the  input.  We  restrict  the  set  of  distributions  the  players 
can  have  as  follows.  The  allowable  distributions  (strategies)  for  the  coder 
are  given  by  a  set  S.  The  collection  [GY(y|a):a  €  a] ,  which  we  denote  by 
is  required  to  be  in  a  set  T  of  allowable  channels.  The  payoff  function 
0(Fx,J'y>  for  this  game  is  taken  to  be  the  mutual  information  I(X;Y)  between 
the  input  to  the  channel  X  and  the  output  of  the  channel  Y.  The  objective 
of  player  I  is  to  choose  Fv  €  S  to  make  0(Fv,J'  )  as  large  as  possible. 

Player  II  chooses  ^  S  T  to  minimize  Thus  associated  with  the 

game  are  two  programs : 

Program  I  (Coder's  Program) 

C'  -  sup  inf  <2(F  ,J>.  ) 

Fx  €  S  ^  €  T 
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Program  II  (Jammer* s  Program) 

C"  -  inf  sup  0(F  )  . 

J>Y  €  T  Fx  6  S  X 

A  strategy  Fx  €  S  such  that  inf(0  (F*,^)  ■  ^  ^  ^  *  C1  is  called  an 
optimal  strategy  for  the  coder.  Similarly  if  sup{0(FY>J'v)  :  Fv  €  S}  ■  C" 
then  is  called  an  optimal  strategy  for  the  jammer. 

It  is  clear  from  the  above  programs  that  C1  <  C"  and  it  is  easy  to  give 
examples  where  C'  <  C".  However,  since  0  is  concave  in  F  and  convex  ini 

A  X 

([27],  Theorems  1.6  and  1.7)  if  S  and  T  are  compact  convex  sets  then 

C'  =  C"  [38].  This  equality  is  equivalent  to  the  existence  of  a  saddle  point 

ic 

i.e.  a  pair  of  strategies  F  €  S,  €  T  such  that 

X  Y 

0(FX,^*)  <  0(Fx,-*y)  <  0(F*,i-Y)  V  Fx  €  S,  6  T  .  (2.1) 

If  (2.1)  holds  then  F*  and  are  optimal  strategies  for  the  coder  and 
jammer  respectively.  This  game  theory,  formulation  was  considered  by 
Dobrushin  [12]  and  Blachman  [  3  ]. 

We  generalize  this  game  theory  formulation  by  allowing  the  players  to 

adopt  n-dimensional  strategies  (i.e.,  non-memoryless  strategies).  We  extend 

the  definition  of  admissible  strategies  to  higher  dimensions  by  using  the 

notion  of  the  mixture  of  a  set  of  distribution  functions.  Let  the  n 

dimensional  distribution  F$.n\x) ,  X  *  (X,  ,...,X  ),  x  =  (x,  ,x.,...,x  )  have 

A  —  n  i  /  n 

marginal  distribution  Fx  (x)  3  F^11^  (*,*,...  ,*,x,*, ...  ,*)  with  the  i-th 
component  being  x.  We  say  Fx^  €  S  ^  if  the  uniform  mixture  of  the 
marginals  is  in  S : 

pCn)  €  S (n)  if  £  Z  F  (x)  6  S  . 

X  n  i=I  X, 


(2.2) 
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The  admissible  strategies  for  the  jammer  are  defined  similarly.  We  say 

A  :  *  €  An]  €  where  G^  <^| a)  is  the  n  dimensional 

conditional  distribution  of  the  output  of  the  channel  given  the  input 

X  *  a,  if  the  uniform  mixture  of  the  conditional  marginals  Gv  (y|a)  is  in  T: 

Yi 

^(n)  €  T(n)  lf  €  -T  (2.3) 

where  3  »  :  ~  2  G„  (y| a. )  €  T,  a  €  An}  is  the  collection  of 

1  1  n  Yi  1  ~ 

conditional  distributions  with  uniform  mixture  of  the  marginals  Gv  (y|a)  in  T. 

Yi 

We  note  here  that  we.  have  restricted  the  strategies  to  those  with  no 
"intersymbol  interference";  i.e.  previous  inputs  are  not  allowed  to  affect 
current  outputs.  For  these  generalized  strategies  we  have  the  following 
programs : 

Program  I  : 


C' 

n 


^>Ts<n> 


A 


<n) 


inf 
€  T 


i(n) 

(n)  0(Fx  nr  ) 


Program  11^: 


C'n  "  j,(n)igfT(n)  F(n)S£Ps  (n)  0(FX° 

where  the  payoff  function  is  now  0(F^n\A^n^)  »  —  I(X;Y).  We  have  the 

x  i  n - 

following  result  concerning  and  C'^. 


Theorem  1:  C' 
-  n 


C'  and  C"  ■  C"  for  all  n  2  1. 
n 


Proof:  First  we  prove  C'  ■  C*.  Let  Fv  be  an  admissible  strategy  i.e. 
*  '  n  x 


F  €  S  and  let  A^n)  €  'T'(ri) 
X  Y 


Tv“'  be  an  admissible  strategy  for  the 
jammer.  Then  if  X  =  (X1,X0,...,X  )  is  a  random  vector  consisting 


of  n  independent  identically  distributed  (i.i.d.)  copies  of  X  we  have 


12 


0(F<n),j£n>)  *  i  r  0(FY,J<v  )  ([271,  Theorem  1.8) 


n  1-1  x  Y1 


1  *<»X'V 


([27],  Theorem  1.7) 


where  is  the  collection  of  uniform  mixtures  of  the  conditional  distributions 

Gv  .  Since  6  j(n)  we  have 
xt  - 

<«0#Up  <n>  (n)lBf  (n)0<Pxn>»JYn>)  ^  SUp  lnf0(F„,Jr) 

F(n>  €  SW  J,W  6  T(n)  i  I  Fv  €  S  J-  €  T  XY 

i  JL  X  Y 

so  that  ^  C.  Now  let  F^  ^  €  S  and  G,y(y|a)  be  arbitrary.  Then  if 
G^  is  the  n-dimensional  distribution  of  Y  *  (Y. , . . . ,Y  )  given  X  -  a 
wi th  Y^  conditionally  independent  then 


0Ovn),-*vn))  ^  Z  (Fy  ([27],  Theorem  1.9) 


X  ’  1 


n  iml 


^  0(Fx,i'Y) 


([27  ] ,  Theorem  1.6) 


where  F„  is  the  uniform  mixture  of  T^n\  i.e.  F  (x)  *  —  I  F,  (x)  . 
X  X  X  n  i=1  X^  ' 

Since  F  €  S  we  have 

X 


inf  .,0(F^n),4n))  ^  inf  0(Fv,J') 


J^“)  Tt^)  5  I 


\  €  T 


s“p  trc\  5  SUP  inf  i(FvA> 


F<“)  €  S (n)  4n>  €  T(n)  ^  - 

X  Y 


Fx  €  S  ^  €  T 


so  that  C’  <  C'.  Thus  C'  =  C'  as  asserted.  Similarly  C"  *  C' 
n  n  *  n 
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What  w'i  have  shown  Is  that  of  all  block  n  memoryless  channels,  the 

channel  with  minimum  mutual  information  is  the  block  1  memory less  channel. 

The  conclusions  one  can  draw  from  this  are  that  memoryless  jaaming  is 

optimal  (GY  J  (z!x)  ■  II  G  (y.|x. ))  and  memory  less  coding  is  optimal 
-  “  i-1  1 

(FY°^*(x)  *  II  (F*  (x, )).  Thus,  of  all  types  of  interference,  the  one  that 

-  i-1  xi 

minimizes  the  mutual  information  is  independent  from  symbol  to  symbol. 

As  an  example  let  A  -  B  -  [0,1, . . . ,M-l}  and  let  T  be  the  set  of  channels 

with* error  probability  per  symbol  less  than  e,  0  <  «  <  1  and  S  be  all 

distributions  on  A.  Then  a  result  of  Dobrushin  [12]  is  that 

/  log  M  +  (1  -  e)log(l  -  e)  +cloge  -  elog(M-l),  c  <  1  -  ^ 

C'  -C"  -<  (2.4) 

lo, 


Here  C'  and  C"  are  measured  in  bits  per  channel  use  and  all  logarithms  have 

•jlf 

base  2.  The  optimal  distribution  FY(x)  is  the  uniform  distribution 

A 

on  (0,1, . . . ,M-l}  and  the  optimal  channel  G  (y|x)  satisfies 


f  «/  (M-l),  y  j4  x,  «<1-^ 

*  •  l 

G  (y|x)  *  ^  1  -  «  ,  y-x,  «<1-- 


(2.5) 


•* 


Here  we  generalize  this  game  to  the  n  dimensional  case  and  apply  the  theorem. 


For  the  generalized  strategies  we  use  the  channel  n  times  to  transmit  n 
symbols.  Let  be  the  error  probability  of  the  i-th  channel.  Then 

,  n  /  v 

is  the  set  of  channels  with  —  Z  «.  <  c.  Also  S ^ 

n  i-i  1 


is  the  set  of 
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distributions  on  An.  •  By  the  Theorem  1  ■  C*  and  C"  ■  C*  and  is  given  in 

(2.4).  The  optimal  strategies  are  memoryless  with  marginals  Fv(x)  and  G-.(y|x) 
given  above.  A  conclusion  one  can  draw  is  that  if  the  average  error 
probability  is  less  than  c  then  with  memoryless  encoding  I(X;Y)  ^  C'  «  C" 
with  equality  for  the  optimal  strategy  given  above. 

As  a  second  example  consider  A  ■  B  *  ]R  ,  the  real  line.  Let 

S  «  {Fv(x):  f  x2  dF„ (x)  <  e}  (2.6) 

X  m  X 

and 

T  -  CGv(ylx):  J  (y-x)2dG„(y| x)  <  N,x€a}.  (2.7) 

y€* 

The  set  of  channels  is  restricted  to  channels  whose  added  noise  has  mean 
square  less  than  or  equal  to  N.  For  S  and  T  given  in  (2.6)  and  (2.7)  a 
result  of  Dobrushin  [ 12]  and  Blachman  [  3 ]  shows  that 

C'  -  C"  -  H  log (1  +  |)  (2.8) 

with  F*(x)  *  §(x/v£)  and  G*(y|x)  =  where  $-(u)  is  given  by 

i  u 

$(u)  -  —  J  e"X  '  dx  .  (2.9) 

»/2tt  -« 

Again  we  generalize  this  game  to  allow  for  n  dimensional  distributions. 

The  set  S  ^  and  T^  are  given  by 

S(n)  -  CF^n)(x):  -  I'  x *x 1  dF^n)(x)  <  e] 

—  B  — 

where  a'  denotes  the  transpose  of  the  vector  a.  Similarly 
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-  £g^(2|x):  i  J’^pCX-SXZ^'^Y^Czl*)  —  N,  x  €  An} . 

By  Theorem  1  ■  CjJ  ■  C'  ■  C"  and  the  optimal  distributions  are  oemoryless 

with  marginal  distributions  being  Gaussian. 

2 .3  Information  Theoretic  Interpretation 

In  this  section  we  give  an  information  theoretic  interpretation  to  the 
results  of  the  previous  sections.  We  consider  the  existence  of  codes  which 
achieve  reliable  communication  for  all  strategies  the  jammer  or  nature  can 
present  to  the  coder.  Here  we  state  the  results  that  apply  from  the 
literature  to  our  particular  problem.  First  we  clarify  the  model  we  are 
considering.  Then  some  definitions  are  necessary  in  order  to  state  the 
results . 

First  we  are  going  to  consider  only  memory less  channels  since  block  n 
memoryless  channels  are  memoryless  channels  with  larger  alphabet  sizes. 

There  are  essentially  two  different  methods  a  jammer  might  choose  a  channel 
from  the  restricted  set  T  in  order  to  minimize  the  performance.  One  way, 
which  results  in  a  channel  called  the  compound  channel  [46],  is  for  the 
jammer  to  choose  a  channel  from  T  and  force  the  coder  to  use  this 
channel  for  every  symbol  transmitted  in  a  codeword.  The  other  way  is  for 
the  jammer  to  choose  an  element  in  T  for  each  symbol  transmitted.  The 
channel  then  might  change  from  symbol  to  symbol  of  a  codeword.  This  is 
called  an  arbitrarily  varying  channel  (AVC)  [46].  Below  we  state  some  results 
on  the  existence  of  codes  for  these  channels.  A  code  (n,M,/<.)  is  defined  as 
a  set  C  (u1,B1),(u2,B2) ,  .  .  . ,  (u^.Bj^)}  where  u^  i  =  1,2,...,M  is  a  length  n 
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sequence  of  symbols,  with  each  symbol  in  A  and  B^,  i  ■  1,2,...,M  are  disjoint 
sets  of  lengjth  n  sequences  with  elements  in  B  (B.  c  Bn,  i  ■  1,2,...,M)  such 
that 


P^(B^  Jui>  <  X  for  i  -  1,2, . . . ,M  and  all  J/  6  T 


where  u^ 


(u^^ *u^2 *  *  *  * 


11  GY(yJuH)> 

3*1  3  3  ij 


(2.10) 

(2.11) 


The  rate  R  of  an  (n,M,X)  code  is  R  «  log  M/n.  The  coding  theorem  and  its 
converse  for  compound  channels  with  A  and  B  finite  are  as  follows. 

Theorem  2  (Wolf owl tz  f46l):  Let  0  <  X  ^  1  be  arbitrary.  Then  there  exists 
a  positive  constant  Kq  independent  of  such  that,  for  any  n,  there  exists  a 
(n,M, X)  code  for  T  with  rate  R  satisfying 

R  >  C'  -  KQA/n  . 

Theorem  3  (Wolfowitz  [46 1):  Let  0  <  X  ^  1  be  arbitrary.  Then  there  exists  a 
positive  constant  independent  of  such  that,  for  any  n,  there  does  not 
exist  a  (n,M,X)  code  for  T  with  rate  R  satisfying 

R  -  C'  +  K^A/n  . 

The  above  theorems  do  not  assume  the  sender  (transmitter)  or  receiver 
know  which  channel  the  jammer  has  selected  for  the  codeword.  If  the  sender 
knows  which  channel  the  jammer  has  selected  then  the  above  theorems  are  valid 
with  C'  replaced  by  C".  If  the  receiver  knows  which  channel  the  jammer  has 
selected  then  the  theorems  are  valid  as  stated. 

The  above  theorems  are  stated  for  the  case  of  finite  alphabo-s. 

When  just  the  output  alphabet  is  infinite  and  the  input  alphabet  is  tinite 
Theorems  2  and  3  are  no  longer  valid  (see  [17]).  For  the  case  of  infinite 

A 

output  alphabet  Theorem  2  is  valid  if  we  replace  C'  by  C'  where 
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C’  -  sup  sup  inf  I(X, [Y]  )*  (2.12) 

Fx  6  S  P  J»y  €  T  p 

P  is  a  partition  of  the  output  alphabet,  and  [Y]p  is  the  quantization  of  Y 
by  P  (see  [27]  p.  34).  If  however,  the  receiver  knows  which  channel  the 
jammer  selected  then  Theorems  2  and  3  are  valid  as  stated.  The  above  results 
for  the  semicontinuous  case  were  proved  by  Kesten  [17].  Note  that  in  the 

A  A 

semicontinuous  case  C*  <  C*  so  that  C'  is  an  upper  bound  on  C'.  In  the 
sequel  we  will  consider  C*  as  the  performance  measure  of  the  channel,  since 

A 

it  is  easier  to  compute  than  C*. 

Consider  now  the  second  method  the  jammer  might  use  to  choose  the 
channel  for  use  by  the  coder.  If  the  jammer  chooses  an  element  of  T  for 
each  symbol  of  a  codeword  transmitted  then  we  have  an  arbitrary  varying 
channel.  The  coding  theorems  for  this  case  are  far  less  complete  than  for 
the  compound  channel.  If  the  output  alphabet  B  consists  cf  only  two  letters 
then  Theorems  2  and  3  are  valid  for  the  AVC  ([46]  Section  6.4).  For  larger 
output  alphabets, see  [10]  for  related  results. 

2 .4  Channels  with  Memory 

In  this  section  we  introduce  a  class  of  block  m  memory less  channels  that 
are  not  block  1  memoryless .  These  channels  are  of  interest  because  they  model 
frequency-hopped  spread-spectrum  channels.  After  describing  the  channel 
models,  we  derive  expressions  for  the  capacity,  cutoff  rate,  and  reliability 
function  for  these  channels. 

Let  [Ag}>  s  €  Cl  denote  a  collection  of  memoryless  channels,  each  with 
input  alphabet  A  and  output  alphabet  B.  The  index  parameter  s  lies  in  a 
set  Cl  on  which  a  probability  distribution  P  is  defined.  Let  S^,S0>...  be  a 
sequence  of  independent  identically  distributed  Cl  valued  random  variables, 
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Che  common  distrlbuCion  being  P.  For  each  integer  m  ^  1  we  define  Che 


channels  A(m)  and  A(m)  with  input  alphabet  A  as  follows.  When  a  sequence 
of  letters  Xq,x^,...  from  A  is  transmitted,  the  k-th  block  of  m  consecutive 
letters,  . . .  .x^^]  *-n  fact  transmitted  over  one  of 

the  component  channels  A  ;  the  random  variable  S,  determining  which  component 
channel  is  used.  If  the  receiver  gets  no  direct  information  concerning  which 
channel  was  used  for  the  transmission  of  the  k-th  block  then  we  call  this 
the  channel  A(m)  without  side  information.  If  with  each  noisy  block  of  m 
symbols  the  receiver  knows  the  index  s  of  the  component  channel  being  used 
to  transmit  that  block  then  we  call  this  the  channel  A(m)  with  side  information 
We  assume  the  transmitter  can  synchronize  to  the  channel  in  the  sense  that  the 
transmitter  knows  which  are  the  first  and  last  letters  in  the  k-th  block  of  m 
letters.  One  further  assumption  is  that  the  receiver  knows  both  the  distribu¬ 
tion  P  and  the  transition  probabilities  of  the  component  channels.  This  last 
assumption  will  be  relaxed  slightly  in  the  next  section. 

Since  the  channel  with  (without)  side  information  can  be  considered 
as  a  memoryless  channel  with  input  alphabet  Am  and  output  alphabet  Bm  X  ft  (Bm) , 
the  capacity  is  found  by  maximizing  the  mutual  information  of  the  memoryless 
channel  over  all  input  distributions.  For  the  channel  without  side  informa¬ 
tion  we  maximize  the  mutual  information  I(X;Y)  between  the  vectors 
X  =  (X1tX-,...,X  )  and  Y  =  (Y. ,Y«, . . . ,Y_)  where 


I (X;Y)  =  E  • 


2.13 
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In  (2.16)  and  (2.17)  Che  maximization  is  over  all  distributions  on  the 
random  vector  X.  If  the  input  distribution  that  achieves  capacity 
(maximizes  mutual  information)  for  each  component  channel  are  identical, 
then  C(m)  is  in  fact  independent  of  m  (C  =  C(m))  and  is  just  the  average 
of  the  capacities  of  the  component  channels  [29]: 


20 


C  -  E  CCg} 


(2.18) 


where  <L  is  the  capacity  of  component  channel  A  .  Furthermore  it  can  be 

y  S 

shown  that  [29] 


C(m)  <  C  , 


(2.19) 


and  if  A  and  B  are  finite  then 


lim  C(m)  =  C 
m  —  ® 


(2.20) 


As  an  example  let  fl  •  [0,1]  and  [a  }  be  the  set  of  binary  symmetric 
channels  with  crossover  probability  s.  For  this  example  A  =  B  =  {0,1]. 

Let  d(x,j£)  denote  the  Hamming  distance  between  the  vectors  x  =  (x^,X2>  . .  •  ,xm) 
and  £  =  (y1>y2.*--,ym)-  The  transition  probabilities  in  (2.14)  then  are 
easily  shown  to  be 


®m,k  "  =  EUk(l-S)m'k},  d(x,Z)  =  k,  k  =  1,2,  ...  ,m  .  (2.21) 

The  mutual  information  for  the  channel  A(m)  without  side  information, 
is  maximized  by  letting  X  have  the  uniform  distribution 
(i.e.  p(x  =  0}  =  p{x  =  l}  =  ^)  with  [x^3^_^  independent  and  identically 
distributed.  The  capacity  C(ra)  is  thus  given  by  (see  Appendix  A) 


1  1  m 

C(m)  =  max  (-  1(X;Y)}  -  1  +  -  Z  (“)a  log^or  .  . 

..  ni  tn  .  «  iC  m  ■  tc  m ,  it 

X  k=0  *  9 


(2.22) 
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The  factor  of  m  in  (2.17)  is  due  to  the  fact  that  we  are  measuring 
the  capacity  in  bits  per  channel  use.  The  mutual  information  for  the  channel 
A(m)  with  side  information  is  maximized  by  the  same  distribution  and  the 
capacity  C(m)  is  given  by 

C(m)  -  max  I(X;Y,S)}  -  E[l  -  H,(S)3  (2.23) 

X  m  * 

where 

H2(s)  =  -slog2s  -  (l-s)log2(l-s)  .  (2.24) 


We  now  consider  the  random  coding  exponent  E^CR)  for  these  channels. 

In  order  to  be  consistent  with  well  established  notations  we  change  slightly 
our  notation.  Let  Q(x)  be  the  distribution  on  the  input  X  to  the  channel 
and  pC^IjO  the  distribution  on  the  output  vector  £  given  the  input  vector  x 
as  before.  The  random  coding  exponent  E^(R)  is  defined  as 

E  (R)  =  max  max[EQ(p  ,Q)  -  pR]  (2.25) 

0  <  o  <  1  Q 

where 

E  (p  ,Q)  =  -log  I  [  I  Q(x)p(y|x)1/(1+p)]1+p.  (2.26) 

y  €  B  x  €  A 

This  function  is  of  interest  because  of  the  following  result  of  Gallager: 
Theorem  4  (Gallager  [13]):  There  exists  on  (n,M,\)  code  with  error  probability 
a.  defined  in  (2.10)  satisfying 

-n  E  (R) 

>.<4.2  (2.27) 

where  R  =  log2M/n.  Furthermore  Zr(R)  is  a  convex,  decreasing,  positive 
function  of  R  for  0  <  R  <  C,  where  C  is  the  capacity  of  the  channel. 


For  block  m  memoryless  channels  (2.25)  and  (2.26)  are  valid  if  x  and  y  are 
replaced  by  x  and  £,A  and  B  by  Am  and  Bm, and  Eq(p,Q)  is  normalized  by  the 
factor  1/m.  Of  special  interest  is  the  cutoff  rate  which  is  defined  as 

Rn  «  max  E  (1,Q) 

0  <5  ° 

which  many  believe  is  the  largest  rate  at  which  practical  coding  systems  can 

be  implemented.  The  cutoff  rate  for  the  channels  considered  here  can  be  computed 

as  follows.  Let  R^  g  denote  the  cutoff  rate  for  component  channel  Ag;  Rg(m) 

the  cutoff  rate  for  the  channel  A(m)  and  R  (m)  the  cutoff  rate  for  the 

0 

channel  A(m).  We  can  express  R„(m)  in  terms  of  R„  as  [29] 

0  U,s 

£0(m)  =  -  i  log2  E[2  m  R°‘S}  <  E[R0jS}  .  (2.28) 

The  cutoff  rate  without  side  information  is,  in  general,  less  than  the 
cutoff  rate  with  side  information; 

RQ(m)  <  Rq  (m)  . 

From  (2.18)  we  see  that  the  capacity  with  side  information  is  independent  of  m. 
However,  the  cutoff  rate  with  side  information  depends  on  m  and,  in  all 
cases  considered,  decreases  as  m  increases  [29],  [43],  The  cutoff  rate  with¬ 
out  side  information  is  also  a  decreasing  function  of  m  for  all  cases 
considered.  This  is  contrary  to  the  increase  in  capacity  with  increasing 
memory  length.  The  limiting  value  of  RQ(m)  as  m  becomes  large  is  given  by  [29l 


lim  R-(m)  =  ess.  inffp.Q  } 

■  _ _  m  *  ^ 


m  —  ® 

which  for  the  case  of  finite  number  of  channels  with  each  having  positive 


probability  is  given  by 


lim  Rg(m)  =  nu-n  rq 
m  -  “  s  €  r.  ’ 


s 


23 


The  function  EQ(p,Q)  for  the  channels  of  the  previous  example  can  be 
calculated.  We  consider  only  those  channels  which  are  symmetric  enough  so 
that  the  maximizing  Q(x)  in  (2.25),  denoted  by  Q*(x),  is  a  constant 
independent  of  x.  Using  Q*(x)  ■  2~m  and  p(i|x)  given  in  (2.21)  we  obtain 
Eo(p,Q*)  for  the  channel  without  side  information  as  (see  Appendix  A) 


EC(P,Q*)  -  P  -  '^logJ  ^0  °Ck 


(2.29) 


with  or  .  given  in  (2.21).  For  the  channel  with  side  information  we  obtain 
m,  K 


i - '  ?  r„k„  „.m-k 


E  (p  »Q*)  =  p-f  log2  Et  z  (“)  !  s  (1-S) 
°  m  Z  k=0  K  i 


,, 


where  the  expectation  is  with  respect  to  the  random  variable  S  with 
distribution  P. 


The  cutoff  rate  RQ  for  any  discrete  memoryless  channel  is  found  by 
maximizing  the  function  Eq(1,Q)  over  all  input  distributions  Q.  For  the 
channel  without  side  information  the  cutoff  rate  Rq  (assuming  Q*(x)  -  2  m) 
is  given  by  (see  Appendix  A) 


R0  •  1  -  I  l0g2 1  =  <k>  am,k 

k=0 


For  the  channel  with  side  information  the  cutoff  rate  Rq  is  given  by 


(2.31) 


1  -  =  -T  "  "  £><!>“  k+i 

Lk=0  2=0  *  — 


(2.32) 
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The  cutoff  rate  is  the  intercept  of  the  random  coding  exponent  E^CR) 
with  the  R  *  0  axis  and  is  the  largest  linear  error  exponent.  Over  a 
range  of  rates  RCr  <  R  <  C,  with  Rcr  a  constant,  the  exponent  in  the  bound 
is  the  largest  possible.  Over  this  range  of  rates  the  random  coding  exponent 
is  equal  to  the  reliability  function  defined  in  Gallager  ([13],  Eq.  5.8.8). 

Let  us  now  consider  a  specific  example  of  these  channels.  Let 
n  -  [0,^],  PCs  “0}  -  1  -  a,  PCs  -  h)  »  e  and  A  »  B  -  C0,l}.  Let  LQ  be 
a  noiseless  channel  and  be  a  useless  channel  (error  probability  %) . 

Then  a  ,  for  the  channel  without  side  information  is  given  by 


a 


m,k 


t  2"m  +  1 


k 


(2.33) 


e  2 


-m 


1.2, 


,m 


Using  (2.31)  in  (2.28)  and  then  (2.28)  in  (2.25)  yields  the  random  coding 
exponent  for  this  channel.  This  is  plotted  in  Figure  2.1  for  various  values 
of  m. 

The  value  of  R  in  Figure  2.1  such  that  Er(R)  =  0  is  the  capacity  C  of 
the  channel  and  the  R  =  0  axis  intercept  is  the  cutoff  rate  Rq.  Note  that 
as  m  increases  the  capacity  increases  so  that  for  rates  sufficiently  large  , 
channels  with  larger  memory  have  larger  random  coding  exponents.  However, 
for  smaller  rates  this  is  no  longer  true  and  channels  with  smaller  memory 
may  have  larger  coding  exponents . 

Consider  now  the  channel  with  side  information.  The  random  coding 
exponent  E^Cp.Q*)  may  be  calculated  as 

Eo(o,0*)  -  p  -  £  log,[l  -  -=  +  e  2mc  ] 
o  m  i 


(2.34) 


This  is  used  in  (2.25)  Co  determine  Che  random  coding  exponent  and  is 
plotted  in  Figure  2.2.  Note  that  the  horizontal  intercept  (the  capacity) 
is  independent  of  m  and  that  at  all  rates  less  than  capacity,  the  random 
coding  exponent  is  larger  for  channels  with  smaller  memory. 

2.5  Channels  with  Memory  and  Jamming 

In  this  section  we  combine  the  models  of  channels  with  memory  of  the 
previous  section  with  the  models  of  channels  with  janxning  of  Section  2.1 
and  2.2  to  model  frequency  hopped  channels  with  non  memoryless  jamming. 

The  channels  with  memory  of  Section  2.3  implicitly  assume  the  receiver  knows 
the  distribution  F  on  the  component  channels  and  the  transition  probabilities 
of  each  component  channel.  In  this  section  we  consider  the  case  of  the 
jammer  choosing  both  the  distribution  P  and  the  component  channels  for  some 
set  of  allowable  distributions  and  allowable  component  channels. 

Consider  a  class  T  of  channels  with  memory.  Each  channel  in  the  class 

has  the  structure  of  the  channels  of  the  previous  section  being  block  m 

memoryless  but  not  block  1  memoryless.  The  jammer  chooses  from  the  set  T 

a  channel  for  the  encoder  and  decoder  to  communicate  through.  Assume  that 

the  jammer  chooses  the  channel  for  each  codeword  so  that  we  are  considering 

the  compound  channel  model.  Then,  since  we  are  assuming  block  memoryless 

channels,  the  capacity  C'  is  the  same  as  given  in  Program  I  of  Section  2.1 

with  given  by  ^  I(X;Y)  for  the  channel  without  side  information 

and  —  I(X;Y,S)  for  the  channel  with  side  information.  The  fact  that  C’ 
m  —  — 

is  the  capacity  is  justified  by  Theorems  2  and  3  for  the  case  of  A,  B,  .T 
finite.  If  B  or  H  is  infinite  then  C1  is  the  capacity  provided  the 
receiver  knows  which  channel  in  T  the  jammer  selected. 


Random  coding  exponent  for  channels  with  memory  m  =  1,4,8,16 
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As  an  example  consider  the  case  A  *  B  *  (Q,l}  and  Q  *  {0,1}.  Let 
P(S  •  1}  ■  e,  p£s  *  0}  ■  1  -  c ,  Aq  be  a  noiseless  binary  channel  and 
a  binary  symetric  channel  with  crossover  probability  of  f(e)  for  some 
decreasing  function  f.  Then  for  each  e  €  [0,1]  we  have  a  different  channel. 
The  jammer  chooses  e  and  thus  the  channel  for  communication. 

The  capacity  C*  of  this  channel  when  no  side  information  is  available 
is  given  by 


min  I(X;Y)} 


0  <  €  <  1 


1  m 

min  {l  +  -  £  log_a  .  } 

0  <  e  <  1  m  k=0  k  m»k  2  m»k 


(2.35) 


where 


1  -e  +  e(l-f(e)) 


k  =  0 


c  fk(€)(l-f(e))<a"k  k  *  1,2, ... ,m  . 


(2.36) 


When  side  information  is  available  then  the  capacity  C'  is  given  by 


min  [(1-O+c  •  (1-H2(f(€)))}  • 

0  <  c  <  1 


(2.37) 


We  will  see  in  Chapters  3  and  4  that  this  example  is  directly  applicable 
to  frequency-hopped  channels  with  partial  band  jamming. 
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2.6  Performance  of  Codes  on  Channels  with  Memory 

Up  till  now  we  have  only  considered  asymptotic  measures  of  Che  channel's 

ability  to  convey  information.  Here  we  compute  the  performance  of  specific 

codes  on  a  particular  channel  with  memory.  Ve  defer  the  performance  of 

codes  on  channels  with  jamming  and  memory  until  later.  The  channel  model 

we  consider  is  that  of  Section  2.3  with  0  *  {0,%},  P(S*0]  ■  1  -  e, 

P£s *  €,  A  *  B  *  (0,l],  Let  Aq  be  a  noiseless  binary  channel  and  A^  a 

binary  symmetric  channel  (BSC)  with  error  probability  For  this  channel 

we  consider  Reed-Solomon  (RS)  codes  and  convolutional  codes  with  interleaving. 

We  also  consider  the  cases  of  side  information  available  and  not  available. 

First  consider  the  case  of  side  information  available  so  that  the 

decoder  knows  which  channel  each  block  of  m  bits  was  transmitted  over.  Since 

the  error  probability  is  %  on  channel  A^  the  decoder  can  erase  all  bits  in 

every  block  of  ra  bits  transmitted  over  A^.  For  R-S  codes  we  treat  a  block  of 

m  bits  as  one  symbol  (in  GF(2m))  of  the  code.  The  probability  of  a  received 

symbol  being  erased  is  just  e.  For  R-S  codes  the  probability  of  a  decoded 

symbol  being  in  error  P  for  a  bounded  distance  decoder  can  be  computed 

e ,  s 

as  [1] 


P  -  £  ^  (")«j(l-On"j 

e’S  j-n-fe+1  n  J 


(2.38) 


If  there  are  more  than  n-k  erasures  the  R-S  code  is  unable  to  recover  the 
erased  symbols.  If  the  decoder  is  unable  to  recover  the  erased  positions  the 
decoder  gueses  the  erased  symbols  .  The  bit  error  probability  Pg  ^  is 
given  by 


P  .  -  *t  p 

e,b  e,s 


(2.39) 
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We  have  plotted  in  Figure  2.3  the  bit  error  probability  for  two  different 

R-S  codes  of  rate  approximately  %.  The  first  is  the  (255,127)  R-S  code  with 

8  _ 

symbols  in  GF(2  ).  We  consider  using  this  code  on  A(8)  (i.e.  m  =  8)  .  The 

other  R-S  code  is  the  (31,15)  code  with  rate  approximately  This  code 
is  used  on  the  channel  A(5)  and  has  symbols  in  GF(2^).  (We  have  plotted 
these  versus  10  logj^l/e)  since  for  partial-band  or  pulsed  jamming  the 
fraction  of  the  band  jammed  or  duty  factor  is  typically  inversely  proportional 
to  the  signal- to- jamming  noise  ratio.) 

The  performance  of  convolutional  codes  on  channel  A(m)  is  considered  next 
Here  we  consider  only  binary  convolutional  codes  with  interleaving.  The  view¬ 
point  we  take  is  that  interleaving  changes  channel  A(m)  into  channel  A(l). 

This  can  be  done  by  having  m  convolutional  encoders  and  decoders.  Each  bit 
in  a  block  of  m  bits  that  is  transmitted  comes  from  a  different  encoder  and 
is  decoded  by  a  separate  decoder.  With  this  interleaving  we  have  the 
channel  A(l)  which  is  just  a  binary  erasure  channel  with  erasure  probability  e 

The  bit  error  probability  P  ,  for  rate  k/n  convolutional  codes  with 

e,b 

Viterbi  decoding  is  bounded  by  ([ 9  ]  Eq.  (6-11)) 


I  w.P. 


(2.40) 


where  d,  is  the  free  distance  of  the  code,  w.  is  the  total  information  weight 
f  J 


of  all  paths  of  weight  j  ,  and  P,.  is  the  error  probability  between  two  words 
differing  in  j  symbols.  For  the  binary  erasure  channel  P.  is  just  \ 


since  for  an  error  to  occur  all  j  symbols  must  be  erased  and  given  that  all 


3.  Error  probability  of  Reed-Solomon  codes  (solid  lines)  and 
convolutional  codes  (dashed  lines)  on  the  interference 
channel  of  example  la  (side  information  available). 


symbols  are  erased  the  error  probability  is  In  Figure  2.3  we  plot  the 
bit  error  probability  given  in  (2.39)  for  two  convolutional  codes  of  rate  %. 
These  codes  are  the  constraint  length  7  (v=6)  and  constraint  length  9  (v  *  8) 
codes  as  given  in  Table  B-2  of  [  9 ]. 

Consider  now  the  case  of  no  side  information  available.  For  R-S  code 


the  probability  of  a  received  symbol  being  in  error  p  is 

s 


ps  =  c(l-  2"m)  =  e(2m-  l)/2m 


The  error  probability  P  of  a  decoded  symbol  with  bounded  distance 

e ,  s 


(2.41) 


decoding  is 


e,s 


n 

E 

j  -a§s+i 


-  (n)pj  a  -  p  >n"J 

n  j  rs  N  rs' 


(2.42) 


If  there  are  more  than  (n-k)/2  errors  the  bounded  distance  decoder  detects 
with  high  probability  that  too  many  errors  have  occurred.  In  this  case  the 
decoder  sets  the  decoded  symbol  equal  to  the  received  symbols.  The  decoded 
bit  error  probability  ^  is  then  given  by 


,m-l 


e’b  i  -  (,^)m  e,s  2m-l 


e ,  s 


(2.43) 


We  have  plotted  in  Figure  2.4  P  ,  for  the  (31,15)  and  the  (255,127)  R-S 

e ,  d 

codes  vs  10  log^g(l/e)  on  channel  A(5)  and  4(8)  respectively. 

The  performance  of  the  convolutional  codes  with  interleaving  on 
channel  4(m)  is  the  same  as  the  performance  of  a  convolutional  code  on 
4(1),  a  BSC  with  crossover  probability  s/2.  For  this  we  use  the  bound  in 
(2.39)  with  P j  given  by 


Error  probability  of  Reed-Solomon  codes  (solid  lines) 
and  convolutional  codes  (dashed  lines)  on  the  interferenc 
channel  of  example  la  (side  information  not  available). 
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P. 

j 


2  (?)(e/2)  (l-e/2)J 

i«(j+l)/2 

< 

>  *Zl  (j71)(e/2)i(l-e/2)j“1_i 
i=j/2 


j  odd 


j  even 


(2.44) 


This  bound  is  plotted  in  Figure  2.4  versus  10  log^Q(l/c). 

In  comparing  Figure  2.3  and  Figure  2.4  we  observe  that  the  degradation 
for  convolutional  codes  (Used  in  conjunction  with  interleaving)  between 
channels  A(m)  and  A(m)  is  much  more  than  the  degradation  for  R-S  codes. 
Furthermore  when  side  information  is  available  the  convolutional  codes 
performance  is  comparable  to  the  (31,15)  R-S  code.  The  (255,127)  code  is  more 
complex  and  has  better  performance  than  the  other  codes.  These  results  are 
not  surprising  since  with  side  information  available  the  channel  capacity 
does  not  depend  on  the  memory  length  so  that  interleaving  should  not  cause  a 
degredation  in  performance.  However  without  side  information  available  the 
capacity  is  an  increasing  function  of  the  memory  which  implies  that  inter¬ 
leaving  without  side  information  should  degrade  the  performance.  The  R-S 
codas  which  do  not  use  interleaving  perform  better  than  the  convolutional 
codes  with  interleaving  when  no  side  information  is  available  as  expected. 

Other  codes  will  be  studied  in  the  next  two  chapters. 
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CHAPTER  3 

CODING  FOR  CHANNELS  WITH  PARTIAL-BAND 
JAMMING  AND  COHERENT  DEMODULATION 

3.1  Introduc tion 

In  this  chapter  we  consider  a  frequency-hopped  spread-spectrum 
communication  system  subject  to  partial  band-jamming.  We  consider  both  binary 
phase  shift  keying  (BPSK)  and  M-ary  orthogonal  signaling  forms  of  modula¬ 
tion.  The  modulated  signal  is  frequency-hopped  to  produce  the  trans¬ 

mitted  signal.  The  received  signal  is  first  frequency-dehopped  and  then 
coherently  demodulated.  The  jammer  adds  noise  to  the  signal  over  only  a 
fraction  of  the  frequency  band  the  transmitter  is  using. 

In  Section  3.2  we  describe  the  channel  models  we  will  use.  In  Section  3.3 
we  calculate  the  capacity  of  BPSK  and  M-ary  orthogonal  signaling  in  the 
presence  of  partial-band  jamming.  We  consider  channels  with  and  without 
side  information  concerning  the  presence  of  the  jammer  and  also  channels 
with  memory.  In  Section  3.4  we  repeat  these  calculations  for  the  cutoff 
rate.  Finally  in  Section  3.5  we  evaluate  the  performance  of  specific  codes 
when  side  information  is  and  is  not  available.  This  is  then  compared  to  the 
cutoff  rate  and  the  channel  capacity. 

3  .2  Channel  Models 

In  this  section  the  channel  models  for  frequency-hopped  spread-spectrum 
communication  using  BPSK  and  M-ary  orthogonal  signals  are  given  when  there 
is  partial-band  jamming.  As  mentioned  in  Chapter  1  we  treat  the  frequency 
hopper  and  dehopper  as  performing  inverse  operations  on  the  modulated 
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signal.  The  output  of  the  frequency  dehopper  consists  of  two  additive 
terms.  The  first  term  corresponds  to  the  received  signal  in  the  absence 
of  noise,  while  the  second  term  is  due  to  the  jamming  noise  and  is  nonzero 
only  if  there  was  jamming  noise  at  the  same  frequency  as  the  transmitted 
signal. 

Consider  frequency  hopping  with  m  symbols  per  hop.  First  we  describe 
the  channel  for  a  particular  hop  for  both  BPSK  and  M-ary  orthogonal  signaling. 
For  BPSK  the  channel  input  alphabet  is  A  ■  (0,l]  while  for  M-ary  orthogonal 
signaling  A  3  (0, 1, . . . ,M-l} .  Assume  that  the  particular  hop  begins  at  time 
t  =  0  and  is  of  duration  ofT  where  T  is  the  duration  of  a  single  symbol.  Denote 
by  Xj,  0  <  j  <  m,  the  random  variable  which  takes  values  in  A.  When  the  input 
X^,  0  <  j  <  ra,  takes  the  value  i  €  A,  the  data  modulated  signal  s^(t  -  jT)  is 
the  input  to  the  frequency  hopper  during  jT  <  t  <  (j+l)T.  The  signal  s  (t) 
is  given  by 

si(t)  *  V2P  pT(t)  sin(u)ct  +  (-l)*-  tt/2)  (3.1) 

for  BPSK  while  for  M-ary  orthogonal  signaling  [s.(t)}.  c  .  is  any  orthogonal 
signal  set  with  each  signal  having  power  P,  duration  T  and  center  frequency 
ojc  (see  for  example  [20], Sec.  5-3).  In  (3.1)  p^(t)  =  1  for  0  <  t  <  T  and 
PT(t)  =  0  otherwise,  P  is  the  signal  power  and  u;c  is  che  center  frequency 
of  the  modulated  signal.  The  frequency  hopper  changes  the  frequency  of  the 
modulated  signal  in  different  hops  to  one  of  q  frequencies  according  to  a 
specified  hopping  pattern  to  produce  the  transmitted  signal  s^(t-jT) 
during  the  interval  jT  <  t  <  (j+l)T,  0  <  j  <  ra.  For  BPSK 

si(t)  =  </2P  pT(t)  sin(-^t  +  (-1) 1  tt/2) 


(3.2) 
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and  w^,  1  S  i  <  q  is  one  of  the  q  possible  frequencies  of  the  hopping 
pattern.  For  M-ary  orthogonal  signaling  {s^t)}^  ^  is  the  same 
orthogonal  signal  set  with  center  frequency  u>.  instead  of  ua . 

The  jamming  j(t)  consists  of  a  sum  of  bandpass  Gaussian  processes: 

q 

j(t)  =  Z  jAt)  (3.3) 

i-1  1 

where  the  process  Cj^(t);  0  ^  t  <  »}  is  a  bandpass  Gaussian  process  with 
center  frequency  uk,  1  <  i  ^  q,  the  q  distinct  frequencies  of  the  hopping 
pattern.  Let  S  (uj)  be  a  low  pass  spectral  density,  i.e.  S  (<u)  =  0  for  |tu|  >  ui^ 
for  some  We  make  the  simplifying  assumption  that  if  j^(t)  has  nonzero 

power  then  S(u  -  ok)  ,  is  the  shape  of  its  spectral  density.  Each  process 
which  has  nonzero  power  has  identical  statistics  and  thus  the  power  in  each 
process  is  the  same.  In  Appendix  B  we  show  that  if  the  receiver  has  side 
information  concerning  which  frequencies  are  jammed  and  at  what  power  levels 
then  in  fact  the  worst  case  jamming  strategy  is  for  the  jammer  to  place  equal 
amounts  of  power  in  a  fraction  of  the  possible  transmitted  frequencies  bands 
and  no  power  in  the  remaining  fraction. 

When  si(t  -  jT)  is  transmitted ,0  <  j  <  m,the  received  signal  r(t)  consists 

of  the  sum  of  the  transmitted  signal  and  the  jamming  signal: 

r(t)  =  Si(t- jT)  +  j(t),  jT<t<(j+l)T  •  (3.4) 

(Here  we  assume,  without  loss  of  generality  that  all  time  delays  are  zero.) 

The  signal  r(t)  at  the  output  of  the  frequency  dehopper  is  then  given  by 

r(t)  =  si(t  -  jT)  +  j£ (t) 


jT  <  t  <  (j+l)T 


(3.5) 
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where  s^(t-jT)  is  the  modulated  signal  and  j^(t)  is  the  bandpass  process 
with  spectral  density  S  (cu  -  cu^)  obtained  from  j(t)  when  j(t)  is  frequency 
translated  by  <u^  —  ui^  and  then  filtered  by  an  ideal  bandpass  filter  with 
center  frequency  («c  and  bandwidth  2uj^.  Here  is  chosen  so  that  s^(t)  is 
essentially  unaltered  when  passed  through  an  ideal  lowpass  filter  with 
cutoff  frequency  u^.  With  probability  p, j^(t)  has  nonzero  power.  A 
detailed  model  for  the  frequency  hopper  and  dehopper  is  given  in  [13]. 

The  models  for  the  jamming  signal  and  transmitted  signal  have  several 
implicit  assumptions  that  should  be  clarified.  First,  it  is  assumed  that 
the  jamming  signal  is  a  stationary  random  process.  Second,  it  is  assumed 
that  the  transmitter  does  not  know  which  frequencies  are  being  jammed  with 
nonzero  power.  If  the  transmitter  knows  which  frequencies  are  being  jammed, 
the  transmitter  could  put  more  power  in  those  frequencies  jammed  and  less  in 
the  frequencies  unjammed.  However,  if  the  jammer  knows  the  transmitter  is 
putting  more  power  in  a  particular  set  of  frequencies,  the  jammer  might 
wish  to  change  the  frequencies  being  jammed  periodically  in  which  case  the 
transmitter  might  not  be  able  to  determine  which  frequencies  are  jammed  at 
a  particular  time.  Assuming  that  j(t)  is  a  stationary  random  process  and 
that  the  transmitter  does  not  know  the  frequencies  being  jammed  is  equivalent 
to  allowing  the  jammer  to  change  the  frequencies  being  jammed  often  enough  so 
that  the  transmitter  cannot  determine  the  jammed  frequencies.  A  further 
assumption  made  is  that  during  each  hop  either  all  the  symbols  are  jammed 
with  equal  power  or  there  is  no  jamming  signal  (.with  nonzero  power)  for 
all  m  symbols.  This  is  perhaps  the  most  restrictive  assumption.  If,  however, 
the  jamming  signal  changes  much  more  slowly  than  the  hopping  rate  then  this 
is  a  reasonable  assumption. 


Xm 
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The  demodulator  has  as  input  r(t)  given  in  (3.5).  For  BPSK  the  demodulator 


computes  the  correlation  Y  between  r(t)  and  s^t) 


(j+l)T 


r(t)  cos  oj  t  dt, 
c 


0  <  j  <  m  , 


(3.6) 


where  Y  is  a  normalization  constant  to  be  defined  later.  For  M-ary 
orthogonal  signaling  the  demodulator  computes 
(j+l)T 

Y.  .  ■  V  J  r(t)s  (t-jT)dt  0  <  j  <  m,  i(A  . 

jT  1 


(3.7) 


Thus  for  BPSK  the  channel  is  described  by  the  input  X^  and  Yj,  0  ^  j  <  m. 

For  M-ary  orthogonal  signaling  the  channel  is  described  by  and 

Y.  ,  i  €  A,  0  <  j  <  m.  Since  we  assume  that  the  jammer's  signal  is  stationary 
1  >  J 

and  that  the  transmitter  does  not  know  which  frequencies  are  being  jammed  the 
channel  is  memoryless  from  hop  to  hop  so  that  the  channel  is  completely 
described  above. 

To  compute  the  distribution  of  the  demodulator  output  we  introduce  a 
random  variable  Z  which  is  nonzero  if  the  jamming  signal  at  the  output  of 
the  frequency  dehopper  has  nonzero  power  and  is  zero  otherwise.  Let 
P(z  »  ,/l/p  ]  =  a  and  P(Z  =  0]  =  1-p.  Then  we  can  describe  the  signal  r(t) 
at  the  output  of  the  frequency  dehopper  by 


r(t)  =  sL(t  -  jT)  +  Z*j(t) 


(3.8) 


where  j(t)  is  a  bandpass  Gaussian  process  with  spectral  density  S  (oj  -  <i)c) . 

We  now  assume  that  S  (u;  -  u>  )  is  flat  in  the  interval  [oj  +'ju  ]  with 

O  C  L  C  L 

two  sided  density  %  N 


i 


For  BPSK  Yj  in  (3.6)  with  y  *  (4/NjT)~  is  a  random  variable  given  by 
Yj  -VI*  M)1  +  Z'H  (3.9) 

where  E  *  PT  is  the  energy  per  symbol  and  T1  is  a  zero  mean  Gaussian  random 
variable  independent  of  Z  with  variance  1.  Thus  Zn  also  has  mean  square  1. 
The  density  of  Yj  given  Xj  =  i  and  Z  =  */l/p  (jammer  on)  is  given  by 


2 

p(yi|x  «  i,  Z  =  VI7p"  )  =  (2tt)“^  •  expC-J^-aV”^^} 


(3.10) 


with  a  =  (-1)  .  When  Z  =  0  (jammer  off)  we  have 


FfY.  -  v^E/N.  (-l)1^.  -  i,  Z  -  0)  -  1  . 

J  J  J 


(3.11) 


Note  that  if  Y.  #  «/2e7nT  (-1)1  then  with  probability  1  the  jammer  was  on 
J  J 

(Z  *  Vl/P  )•  Using  this  test  the  receiver  can  tell  whether  or  not  the 

jammer  was  on  during  a  particular  hop.  In  this  case  we  say  the  receiver  has 

side  information  available.  However,  the  receiver  may  just  decide  X^  =  1 

if  Yj  <  0  and  Xj  *=  0  otherwise.  In  this  case  we  say  the  receiver  makes  hard 

decisions  and  disregards  the  side  information.  Alternatively  the  receiver 

may  make  hard  decisions  and  retain  the  side  information. 

For  M-ary  orthogonal  signaling  Y.  .  in  (3.7)  with  y  =  (2/N  T)  “  and 

i ,  j  J 

Xj  ”  i  is  given  by 


Z-T!  k  =  0,1,  ...,M-1 


(3.12) 


where  E  is  the  energy  of  each  signal  in  the  set,  Z  and  ?  are  the  same  as 

before  and  5.  .  =  1  if  i  =  k  and  5,  .  =  0  otherwise.  The  density  of  Y, 

k,i  k,i  7  k,  j 

given  Xj  =  i  and  Z  =  /?  is  given  by  (3.10)  with  j.  = 


► 


-  1. 


If  Z=0 
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pCYk,j  -^Vi|xj  -1’ 


Z  -  0}  *  1 


(3.13) 


JE 

"  VT 


Thus  side  information  is  available  by  checking  if  Y,  ,  *  V  rr-  6.  .  for 

K,J  Nj 

some  i  €  A.  Hard  decisions  correspond  to  deciding  X.  ■  i  if  Y.  ,  >  Y,  . 

j  *>j 

for  all  k  j4  i.  We  consider  hard  decisions  both  with  and  without  side 
information  available. 

3.3  Channel  Capacity 

In  this  section  we  derive  expressions  for  the  capacity  of  the  channels 
described  in  the  previous  section.  The  capacity  is  found  from  the  game 
theoretic  formulation  of  Chapter  2  with  the  jammer  choosing  the  duty  factor  p 
We  compare  this  to  the  case  of  uniform  jamming  (p  =1).  We  conclude  that 
provided  codes  with  rate  less  than  some  critical  rate  are  used  uniform 
jamming  is  the  worst  case  jamming  strategy. 

First  consider  BPSK  and  side  information  available  to  the  receiver. 

There  are  two  binary  input  channels  involved  here.  When  the  jammer  is  on, 
the  channel  is  just  an  additive  Gaussian  noise  channel  with  signal 
energy- to-noise  variance  ratio  2EP/Nj.  The  capacity  C(Ep/Nj)  of  this 
component  channel  is  achieved  with  a  uniform  distribution  on  A  and  is  given 
by  ([  6  ]  [  27,  Problem  4.14]) 


2  2 

C(x)  ■  (x  -  J  g(t)£n  cosh(x  +tx)dt}/in2 


(3.14) 


where  g(t)  is  the  density  of  a  zero-mean,  unit  variance  Gaussian  random 
variable  given  by 


-3,  t . .  2 

g(t)  =  (2n)  ‘  e "2t 


(3.15) 
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When  Che  jammer  is  off  che  componenc  channel  is  a  binary  noiseless 
channel  wich  capaciCy  1  achieved  by  a  uniform  disCribuCion  on  A.  Thus  boch 
component  channels  have  Che  same  inpuc  distribution  achieving  Che  component 
capaciCy.  In  this  case  from  (2.18)  Che  capaciCy  of  Che  composite  channel  is 
independent  of  the  memory  length  m  of  the  channel.  Thus  the  capacity 
C(E/Nj)  for  BPSK  with  worst  case  partial-band  jamming  is  given  by 

C(E/N  )  *  min  [p  C(Ep/N  )  +  (1  -  p )}  .  (3.16) 

J  0  <  p  <  1  J 

The  minimum  in  (3.16)  can  be  found  numerically  or  by  setting  the  first 
derivative  equal  to  zero: 

^  {pC(Ep/NJ)  +  (l-p)3  »  0 
or 

C(Ep/Nj)  +  Ep/Nj  C'  (Ep /Nj)  =  1  (3.17) 

where  C'(x)  =  oC(x)/3x  .  From  (3.17)  we  can  determine  the  dependence  of  the 
worst  case  p  =  p*  on  the  signal-to-noise  ratio  E/N_  as 

*J 


where  a  is  the  solution  of 


E/Nj  <  a 

E/Nj  2:  a 


(3.18) 


C  (a )  +  aC '  (a )  =  1 


(3.19) 


Using  (3.18)  in  (3.16)  we  obtain 
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CCE/Nj) 


CCE/Nj) 


a  -  aCCa) 


E/Nj  <  a 


E/Nj.  *  a 


(3.20) 


Solving  (3.19)  we  find  that  a  ■  1.649  and  C(a)  =  0.655.  If  we  now  have  a 
different  type  of  receiver  capacity  6  (J3 )  in  the  presence  of  additive 
Gaussian  noise  with  signal-to-noise  ratio  |3  then  with  partial-band  jamming 
(3.16)-(3.20)  are  valid  with  C  replaced  by  C.  For  BPSK  with  hard  decision 
receiver  and  additive  Gaussian  noise  the  error  probability  is  given  by 

CD 

Q (s/2E /N  )  where  Q(x)  =  J  g(t)dt.  The  capacity  is  then  given  by  [27] 


C2({5)  *  1-H2 (0(726)) 


(3.21) 


where  g  *  E/N^.  Using  (3.21)  in  (3.19)  and  solving  for  a  we  find  a 2  *  2.156 
and  C2(a2)  »  0.630.  Thus  for  BPSK  with  hard  decisions  and  side  information 
the  capacity  C2(E/Nj)  is  given  by 


c2(e/V 


E/NJ  <  *2 


C2(E/Nj)  - 


c^2  •  a2^Z  ^*2^ 


(3.22) 


E/^  *  -J2 


Now  consider  the  case  of  no  side  information  available  and  hard 
decisions.  Since  side  information  is  no  longer  available  the  capacity  is  no 
longer  independent  of  the  memory.  However  this  channel  fits  exactly  the 
channel  model  in  the  example  of  Section  2.5  with  e  =  p  and  f(p)  =  Q 0/2E: / N  ) 
so  that  the  capacity  is  given  by  (2.33)  and  (2.36).  The  minimization  in 


(2.34)  must  in  general  be  done  numerically.  However  for  the  case  of  no 
memory  (m  *  1)  the  channel  becomes  a  BSC  with  crossover  probability  p  given 
by  the  average  of  the  crossover  probabilities  of  the  two  component  channels: 


p  -  p.  Q(v/2Ep  /Nj)  +  (1  -p)»0  -  p  QCv/2Ep7N^) 


(3.23) 


so  that  the  capacity  is  the  minimum  of  1-H2(p)  over  p  €  [0,1].  Since 
1-H2(x)  is  decreasing  function  of  x  we  can  equivalently  maximize  p  over  p 


max  p 

0  <  p  <  1 


QV2Ep/Nj) 


I/Nj  <  or3 


E/Nj  *  a3 


(3.24) 


in  which  case 


C(E/NJ) 


min  1  -  H„  (p)  = 

0  <  p  <  1 


1  -  H2(Q(y2E/Nj)  E/Nj  <  0-3 


-(ft) 


E/N3  *  c3 


(3.25) 


where  =  0.709,  S3  =  0.08285,  and  C(a3)  =  0.480. 

For  M-ary  orthogonal  signaling  we  consider  only  the  case  of  hard 

decisions.  The  probability  P  of  an  error  (Y.  .  >  Y.  ,  for  some  k  *  i 

e»s  k, j  i,J 

when  Xj  =  i)  for  uniform  jamming  can  be  calculated  to  be  [1] 


Pe,s(E/V  =  (>1'1)  *  «(t.^)^(t)g(t)dt 


(3.26) 


where  g(t)  is  given  in  (3.15)  and  §(x)  =  l-Q(x).  For  the  case  of  side 
information  available  and  partial-band  jamming  the  capacity  can  be  calculated 
using  (3 . 16)- (3 .20)  with  C(a)  replaced  by  C^(Pe  s(^))  where 
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Si(P)  =  I^Tm  ^log2M  +  a-P)log2(1‘P)+P  loS2 (P/<M-1)3  .  (3.27) 


The  capacity  (in  M-ary  units)  is  then  given  by 


/  - 


Cm(E/Nj)  - 


1  - 


YM  *  VA<P«  J 
E/N, 


E/Nj  <  yM 


E/NJ  =  YM 


(3.28) 


When  side  information  is  not  available  the  capacity  depends  on  the  memory 
length.  For  m  =  1  the  channel  is  a  memoryless  M-ary  symmetric  channel 
(MSC)  with  symbol  error  probability  given  by  the  average  error  probabilities 
of  the  two  component  channels.  As  before  the  capacity  is  a  decreasing 
function  of  the  symbol  error  probability  so  that  maximizing  symbol  error 
probability  is  equivalent  to  minimizing  capacity.  The  maximum  of  the 
average  error  probability  P  (E/N.)  is  given  by 

0  *  S  j 


P  (E/N  )  =  max  (p  P  (Ec/N.)} 

5  J  0<D<1  8  J 


(  P.ff/Nj) 


-( 


EAt. 


E/SJ  < 

E/NJ  2  V 


(3.29) 


The  capacity  (E/N T)  is  found  by  using  (3.27)  with  P  =  P  (E/N  )  given  in 

“  9  J 

(3.29).  Thus 


■ 

The  values  of 

VM’ 

Si  and 

W  are 

given  in  Table  3.1  for 

M 

M  =  2k,  k  ■  1,2,.. 

• 

oo 

• 

Table  3.1.  Values 

of  constants 

used  to 

determine  capacities  for  M-ary 

orthogonal  signaling. 

M  Y 

yM 

W 

Hi 

vv 

* 

2  2.156 

0.630 

1.418 

0.117 

0.480 

4  2.402 

0.596 

1.701 

0.211 

0.461 

8  2.631 

0.563 

2.012 

0.2S7 

0.443 

s 

16  2.987 

0.532 

2.345 

0.350 

0.424 

32  3.315 

0.504 

2.699 

0.402 

0.407 

. 

64  3.664 

0.478 

3.069 

0.446 

0.390 

'« 

128  4.030 

0.454 

3.455 

0.484 

0.374 

256  4.410 

0.432 

3.853 

0.516 

0.359 

i 

\ 

To  interpret 

these  results 

concerning  the  channel  capacity  we  consider 

i 

Theorem  2  of  Chapter  2  which  says  that 

there  exists 

codes  with  rate  r  <  C, 

such  Chat  reliable  communication  (error  probability  less  than  >.)  is  possible. 
•  In  all  cases  considered  here  the  capacity  is  a  function  of  E/N  the  symbol 

sJ 


< 


L 
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signal-to-noise  ratio  (SNR).  If  we  use  codes  of  rate  r  then  the  bit 
signal-to-noise  ratio  E^/Nj  is  given  by 

Efa/NJ  -  (E/Nj.)  •  (1/r  log2M) 

where  M  =  2  for  BPSK.  Thus  for  reliable  communication  we  must  have 

r  <  C (E^/Nj  •  r  log2M) 
or 

Eb/NJ  >  c_1<r)/r  1o82M  (3.31) 

where  C  ^(r)  is  the  inverse  function  of  the  capacity.  The  performance  of 
a  particular  modulation-demodulation  scheme  can  be  measured  by  the  right 

hand  side  (RHS)  of  (3.31)  and  determines  the  bit  signal-to-noise  ratio  needed 

/ 

for  reliable  communication.  f 

For  soft  decision  BPSK  the  capacity  with  side  information  is  given  by 
(3.20).  In  Figure  3.1  we  plot  RHS  of  (3.31)  with  C  given  in  (3.20).  This 
is  compared  to  the  bit  SNR  needed  to  achieve  capacity  for  uniform  jamming. 
Note  that  for  small  enough  code  rate  (r  <  0.655)  uniform  jamming  is  the 
optimal  strategy  for  the  jammer. 

For  hard  decisions  BPSK  (binary  output  quantization)  we  have  two  cases 
to  consider.  With  side  information  available, so  that  capacity  is 
independent  of  memory  length,  the  minimum  E^/N^  as  a  function  of  r  is  given 
in  Figure  3.2.  The  rate  below  which  uniform  jamming  is  optimum  is  0.630. 

When  side  information  is  available  the  capacity  depends  on  the  memory 
length.  For  m  =  1  the  capacity  is  given  by  (3.25)  for  1  <  m  <  ®  the 


Partial -band  jamming 


capacity  is  given  in  (2.35)  with  6  *  p  and  ^  given  by 


(  (1-P)  +  pa-QCv^Ep/Nj))111  k  =  0 


a 


m,  k 


< 

k  P  Q (v^2Ep  /Nj)k(l  -  Q Cs/2Ep TnJ) )m"k  k  =  1,2,  ...,m 


(3.32) 


The  minimum  in  (2.35)  no  longer  has  the  simple  form  of  before.  In 

Figure  3.2  we  plot  the  E./N-  necessary  for  reliable  communication  for 

o  j 

m  =  16  without  side  information  and  E,/Nt  with  side  information. 

d  J 

For  M-ary  orthogonal  signaling  the  corresponding  curves  for  m  *  1 
(memoryless)  and  M  =  4,8,16,32  are  shown  in  Figures  3. 3-3. 6.  The  rates 
below  which  uniform  jamming  is  optimal  are  given  in  Table  3.1.  The  increase 
in  need  Co  achieve  capacity  at  low  rates  is  due  to  the  form  of  modulation 

employed.  The  increase  for  high  rates  is  due  to  the  decrease  in  the  codes 
redundancy  at  these  rates.  M-ary  orthogonal  signaling  can  also  be  viewed  as 
a  form  of  coding.  It  is  an  orthogonal  code  with  rate  (log2M)/M.  If  an 
outer  code  with  rate  r  is  used  on  the  code  words  of  the  M-ary  orthogonal 
code  then  the  overall  code  rate  r'  is  r'  =  r  log^M/M.  Figures  3. 3-3. 6 
could  be  plotted  versus  the  overall  r'  instead  of  r,  however,  the  same 
effect  for  low  and  high  code  rates  would  still  be  present.  We  could  also 
compare  these  curves  to  those  for  BPSK  to  determine  the  loss  incurred  by 
using  an  orthogonal  code  as  an  inner  code  in  a  concatenated  coding  approach. 
Even  though  M-ary  orthogonal  signaling  (for  finite  M)  is  less  efficient 
than  BPSK,  we  shall  see  that  it  can  be  combined  with  Reed-Solomon  codes  to 


provide  performance  comparable  to  BFSK. 


Part  ini -hand  Jamming 


Figure  3.3.  F.^/N  ^  needed  to  achieve  capacity  for  4-ary  orthogonal 

signaling  will)  partial -band  jamming  and  hard  decisions 


l’art i;il -band  jamming 

without  side  information 


E  /Nj  needed  to  achieve  capacity  for  8-ary  orthogonal  signaling 
with  part  ia  I -hand  jamming  and  hard  decisions. 


l’artial-baiu!  Jamming 

without  side  information 


I’^/N  (  needed  to  acliieve  capacity  for  16-ary  orthogonal 
signaling  with  partial-hand  jamming  and  hard  decisions 


Partial-band  jamming 
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3.4  Channel  Cutoff  Rate 

In  this  section  we  derive  expressions  for  the  computational  cutoff 

rate'  for  channels  with  partial-band  jamming.  The  cutoff -rate  of  BPSK - 

with  soft  decisions,  side  information  and  memory  has  been  calculated  by 
Viterbi  [43].  We  extend  these  results  to  Include  BPSK  with  hard 
decisions  with  and  without  side  information  available.  We  also  calculate 
the  cutoff  rate  for  M-ary  orthogonal  signaling  with  soft.  and.  hard  decisions. 

Consider  first  the  case  of  side  information  available.  From  (2.28)  the 
cutoff  rate  with  side  information  and  memory  m  is  given  by 


R0(m)  *  “  m  log2  Etjm<S>3 


(3.33) 


where 


(3.34) 


and  Rq  g  is  the  cutoff  rate  of  the  component  channel  As>  However  (3.33)  and 

(3.34)  are  valid  only  when  the  distribution  that  achieves  ^  in  (2.27)  is 
the  same  for  all  component  channels.  This  assumption  will  be  true  for  all 
channels  considered  here.  Viterbi  [43]  has  computed  the  cutoff  rate  for  the 
case  of  BPSK  with  soft  decisions  and  partial  band  jamming  as 


Vm)  = 


min 


0  <  p  <  1 


f  l  r  -aE/Nl 

•Jl  -  i  log2((l  -p)  +  p  1  +  e  J  > 


l 


J 


1  -  logJl 

L 


\  1  -  -  log2 


;e/njj 


r  (j, 

1  + 


—  1 

E/NjJ 


E/Nt  <  v 
J  m 


E/N.  ^  v 
J  m 


(3.35) 


(3.36) 


The  constants  in  (3.36)  are  given  in  Table  3.2. 
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Table  3.2.  Constants  for  computing  cutoff  rate  for  BPSK  with 
partial-band  jamming. 


m 

m 

m 

Ym 

r 

m 

1 

.368 

1.000 

0.6038 

1.707 

2 

.882 

0.850 

1.439 

1.443 

3 

1.646 

0.759 

2.670 

1.187 

4 

2.854 

0.579 

4.603 

0.963 

5 

4.856 

0.475 

7.796 

0.784 

6 

8.287 

0.395 

13.258 

0.646 

7 

14.303 

0.335 

22.819 

0.544 

8 

25.018 

0.288 

39.829 

0.467 

For  M-ary  orthogonal  signaling  with  uniform  jamming,  m  =  1  and  sof ; 
decisions  the  channel  cutoff  rate  is  given  by  [ 16] 


R0(M)  =  -log2  J  1  +  (M-l) 


-E/2Sj, 


(3.37) 


where  Rq  is  measured  in  bits  per  transmission.  For  partial-band  jamming 
with  side  information  available,  memory  m  =  1  and  soft  decisions  the  cutoff 


rate  Rq(M)  from  (3.33)  and  (3.34)  is  given  by 


Rn(M)  *  min  Aog-M  -  log,  1  -  p  +  p  1+  (M-l)e 

0<  =  <i|_  L  V 

The  minimization  can  be  done  easily  to  give  the  worst  case  p  =  c 'c  for 


-Ep/2N  VO 
'  ))] 


(3.38) 


partial-band  jamming  as 
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l  E/Nj 


E/Nj  <  2 


E/Nj  ^  2 


so  Chat 


Rp(M) 


log2M  -  log^l+(M-l)e 


-E/2N 


1 


,  E/Nj  <  2 


|  log2M  -  log  1  +  2  (M-l)e-1/  (E/Nj) ,  E/Nj 
•  • 


*  2 


It  is  interesting  to  compute  the  limit  as  M  -  «  in  (3.40). 


lim  R  (JO 
M  -  « 


(E/2NJ)log2e  ,  E/Nj  <  2 


log2(e  E/2N j.)  ,  E/Nj  *  2 


(3.39) 


(3.40) 


(3.41) 


while  for  uniform  jamming  (p  =  1)  the  limit  as  M  -  ®  of  RQ  is  just 
(E/2Nj)log2e.  Thus  for  uniform  jamming  Rq  is  a  linearly  increasing  function 
of  E/Nj  while  for  partial-band  jamming  Rq  is  increasing  logarithmically. 
Similar  calculations  can  be  done  for  the  case  of  memory  m  >  1  and  M-ary 
orthogonal  signaling. 

For  BPSK  and  hard  decisions  the  error  probability  with  uniform  jamming 
is  given  by 


p  =  QCy/ZE/Nj  ) 


(3.42) 


and  the  cutoff  rate  by 


R0  -  1  -  iog2(i+Vp(l-p)) 


=  -log,(l+2/p(l-?))/2 


(3.43) 
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—(2 \ 

From  (3.33)  we  can  compute  the  cutoff  rate  Rq  ' (m)  for  partial-band 

v 

jamming  with  side  information,  hard  decisions  and  memory  m  as 

R«2)(m)  =  min  Cl  -  ^  log  [1  -  p +p  (1  +  2v^(i^)‘)m]}  (3.44) 

u  o  <  p  <  1  ra 


where  p 


Q(/2Ep/N j) .  The  minimization  in  (3.45)  can  be  done  to  yield 


-  1  -  log2(l  +  2s/p(l-p)) 

'  1‘  mlog2^1  +  E7N^) 


e/nt  <  r 

J  m 


e/n  s  r 

J  m 


(3.45) 


The  constants  y  and  F  are  given  in  Table  3.2  for  1  <  m  <  8. 
m  m 

When  no  side  information  is  available  the  channel  is  simply  a  block  m 
memoryless  channel.  The  cutoff  rate  is  given  by  (see  (2.31)) 


RQ(m) 


min 

0  <  p  <  1 


m 

*  0 
k=0 


(3.46) 


with  a  given  in  (3.32).  For  m  =  1,  however,  the  channel  is  simply  a 
in,  lc 

BSC  with  error  probability  pQ(v/2Eo  /N^)  so  that  minimizing  the  cutoff 
rate  is  equivalent  to  maximizing  the  error  probability.  This  maximum  is 
given  by 


P  = 


max  0O(v'2Eo/Nt)  =  < 
0  <  c  <  1  J 


Q0/2e7Nj) 


0.08285 


E/N. 


E/NJ  >  0.709 


E/Nj  <  0.709 


(3.47) 


and  the  cutoff  race  by  using  (3.47)  in  (3.43). 
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E 


e 


For  M-ary  orthogonal  modulation  with  memory  m  ■  1  and  hard  decisions 


the  cutoff  rate  Rq  with  uniform  jamming  is  given  by  (measured  in  M-ary  units) 


(3.48) 


so  that  the  cutoff  rate  with  partial-band  jamming  is  given  by 


where  a.,  and  3  are  given  in  Table  3.3.  When  no  side  information  is 
MM 

available  the  cutoff  rate  is  found  by  using  (3.48)  with  P  replaced  by  P 

s  s 

given  in  (3 .29) . 

— (2) 

Table  3.3.  Constants  used  to  determine  Rq  '(>1). 


M 

*M 

2 

3.415 

1.208 

4 

3.347 

3.744 

8 

3.307 

9.240 

16 

3.335 

21.443 

32 

3.444 

48.915 

64 

3.627 

111.088 

We  interpret  these  results  in  the  same  way  as  we  did  for  capacity. 

For  all  cases  the  cutoff  rate  Rq(E/Nj)  is  a  function  of  the  symbol  signal- 
to-noise  ratio.  If  we  use  codes  with  rate  r  <  Rq(E/N^)  then  we  must  have 

Efa/NJ  >  Rj^OO/flogjM  (3.5 

for  reliable  communication  (from  cutoff  rate  considerations). 

In  Figure  (3.7)  we  show  the  E^/Nj  needed  to  achieve  Rq  for  BPSK  with 
soft  decisions  and  side  information  available  (memory  1) .  Both  partial-band 
and  uniform  jamming  cases  are  shown.  For  hard  decisions  with  BPSK  the  three 
cases  (i)  partial-band  jamming,  no  side  information  (ii)  partial-band  jamming 
with  side  information  and  (iii)  uniform  jamming  are  shown.  In  Figure  3.9 
the  case  of  hard  decisions,  side  information  and  memory  is  considered  for 
m  =  1,2, 4, 8.  Notice  that  as  m  increases  the  necessary  E^Nj.  also  increases. 
For  capacity  we  saw  a  decrease  in  E,  /N  when  memory  was  increased.  For 

D  J 

channels  with  memory  capacity  is  a  better  measure  of  a  channel  reliability 
than  the  cutoff  rate.  In  Figures  3.10  and  3.11  the  E,  /N  needed  to  achieve 

U  J 

Rq  is  shown  for  16-ary  and  32-ary  orthogonal  signaling  with  hard  decisions. 

3 .5  Performance  of  Codes 

In  this  section  we  compute  the  performance  of  specific  codes  on  channels 
with  partial-band  jamming.  We  consider  both  BPSK  and  M-ary  orthogonal 
signaling  forms  of  modulation  with  coherent  demodulation.  Three  different 
types  of  receivers  are  considered:  (i)  soft  decisions,  side  information 
available,  (ii)  hard  decisions , side  information  available,  and  (iii) 
hard  decisions  no  side  information  available. 


Uniform  jamming 


Figure  3.7.  K  /N  (  needed  to  achieve  cutoff  rate  for  BPSK  with  soft  decisions  and 
partial-hand  Jamming  (side  information  available). 


No  side  Information 


to  achieve  c.  ;  >:ates  for  BPSK  with  hard  decisions  and 


With  side  information 


Figure  3.10.  E,  /N  needed  to  achieve  cutoff  rate  for  16-ary  orthogonal  signaling 
h  J 

with  hard  decisions  and  partial-band  jamming. 


With  side  information 


Figure  3.11.  F.^/N ^  needed  to  achieve  cutoff  rate  for  32-ary  orthogonal  signaling 

with  hard  decisions  and  partial-band  jamming. 
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There  are  several  types  of  codes  we  consider  in  combination  with  the 
different  types  of  modulation.  We  consider  channels  with  memory  (m  >  1)  and 
without  memory  (m  *  1).  One  way  of  distinguishing  codes  is  by  the 
alphabet  size  of  the  code  symbols.  Codes  which  have  symbols  over  alphabets 
larger  than  two  are  capable  of  treating  symbols  from  an  M-ary  form  of  modula¬ 
tion  as  one  symbol  in  the  code.  Binary  codes  can  also  be  used  with  M-ary 
modulation  by  treating  one  symbol  as  log2M  bits  and  encoding  each  bit 
separately.  This  is  a  form  of  interleaving  and  when  used  on  channels  . 
without  side  information  can  degrade  the  channel  reliability  from  capacity 
considerations.  However  the  performance  of  specific  codes  must  be  evaluated 
since  the  overall  performance  depends  also  on  the  type  of  codes  used  on 
these  channels. 

Consider  first  M-ary  orthogonal  signaling  with  no  memory  (m  *  1),  no 

side  information  available  and  hard  decisions.  The  symbol  error  probability 

for  the  worst-case  partial-band  jammer  is  given  in  (3.29).  If  we  use  R-S 

codes  in  conjunction  with  M-ary  orthogonal  modulation  then  the  decoded 

symbol  error  probability  P  can  be  found  by  using  (3.29)  in  (2.42)  with 

e ,  s 

P  in  (2.42)  replaced  by  P  (E/N  ).  The  decoded  bit  error  probability  P  , 

S  S  J  6  j  D 

can  then  be  computed  as 


.  *  JL  P 

*  M-l  e.s 


(3.52) 


Another  type  of  code  with  alphabet  size  greater  than  2  is  the  dual-k 
convolutional  code  [30],  [44],  This  code  has  alphabet  size  2  and  can  be 
used  with  M-ary  modulation  (M  =  2  ).  The  performance  of  this  code  can  be 
evaluated  using  (2.40).  The  summation  in  (2.40)  can  be  approximated  by 
the  first  several  terms.  The  evaluation  of  (2.40)  requires  the  calculation 


I 
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of  Pj,  the  error  probability  between  two  words,  differing  in  j  symbols.  This 
calculation  for  an  M-ary  symetric  channel  is  done  in  Appendix  C. 

A  bound  on  (2.40)  can  be  obtained  by  bounding  by  where  for  an  M-ary 

symetric  channel  with  symbol  error  probability  P  ,D  is  given  by  [27,  Prob.  7.10] 


D  *  <£t>  ?s  +  2^i-?a)PB/(M-l)  . 


(3.53) 


Using  this  bound  on  Pj  the  series  in  (2.40)  can  be  summed  for  dual-k  codes 
with  rate  1/v  to  yield  [30] 


lc  2  v 

P  ^  (2tC-l)D^V 

®’S  [1  -  vD''"1  -  (2k- 1  -  v)DV]2 


(3.54) 


The  bit  error  probability  can  be  evaluated  using  (3.52).  The  in  (2.40) 
can  be  evaluated  from  (3.54)  by  expanding  the  denominator  into  a  series 
in  D.  Doing  this  w..  is  the  coefficient  of  the  term  DJ . 

Still  another  code  which  has  code  symbols  of  size  greater  than  2  is 
the  length  n  repetition  code.  This  simple  code  transmits  each  symbol  n  times 
in  a  row.  The  rate  of  this  code  is  1/n.  For  a  receiver  with  hard  decisions 
the  decoder  counts  the  number  of  times  the  receiver  decides  each  symbol 
was  transmitted  and  then  chooses  the  symbol  that  was  decided  upon  the  most. 

If  there  is  a  tie  between  2  or  more  symbols  the  decoder  choses  one  randomly. 
The  symbol  error  probability  for  these  codes  is  derived  in  Appendix  C  for 
1  <  n  <  8.  The  form  of  the  error  probability  P  is 

6  %  S 


=  1  -  £  a.  Pi  (1-P  )’ 


(3.55) 


where  a^  are  constants  that  depend  on  M,  the  symbol  size  and  Pg  is  the 
uncoded  symbol  error  probability. 
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As  mentioned  previously  we  can  also  use  binary  codes  with  M-ary 
modulation.  We  do  this  ly  treating  each  M-ary  symbol  as  log^M  bits  and 
encoding  each  bit  separately.  The  uncoded  bit  error  probability  is 
given  by 


,  M  - 
**  M-l  Ps 


(3.56) 


Now  the  channel  is  a  BSC  with  crossover  probability  P,  .  The  bit  error 

D 

probability  for  binary  convolutional  codes  can  be  evaluated  using  the  first 
several  terms  in  (2.40)  and  using  (2.44).  The  w^  are  tabulated  in  [  9  ] 
Appendix  B  for  some  convolutional  codes. 

Now  consider  the  case  of  hard  decisions,  no  memory  (m=l)  and  side 
information  available.  For  this  case  consider  the  repetition  code  with  M-ary 
modulation.  If  just  one  symbol  in  a  codeword  is  not  jammed  then  the  decoder 
decides  the  transmitted  symbol  was  the  symbol  received  with  no  jamming.  The 
error  probability  in  this  case  is  zero  since  there  is  no  noise  in  the  unjammed 
channels.  Thus  for  an  error  to  occur  all  n  symbols  of  the  repetition  code 
must  be  jammed.  If  the  jammer  is  a  partial-band  jammer  then  the  probability 
of  n  symbols  being  jammed  is  pU.  The  symbol  error  probability  for  this 


code  is 


max  £p  [1  —  l  a.P  (Ep/NT)  (1-P  (Eo/N.))  ]}(3.o/) 

_  i  .  _  is  J  s  J 

0  <  p  <  1  1=0 


where  P  (•)  is  given  in  (3.26).  This  maximum  has  the  form 


1  -  :  a . P^(E/N  T) (1  -  p  (E/N  ))n  1  E/N  <  A 

i=Q  1  s  J  s  J  J  M,n 


(3.58) 


BM,n/(£/V 


E/Nt  >  A 
J  —  M,n 
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for  some  constants  ^  and  The  bit  error  probability  can  be  calculated 

using  (3.52). 

The  performance  of  the  repetition  code  with  soft  decisions  and  side 
information  available  can  also  be  computed.  As  with  hard  decisions,  the  jammer 
is  forced  to  jam  all  symbols  in  a  codeword  of  a  repetition  code  for  an  error 
to  occur.  The  symbol  error  probability  can  be  computed  as 


P^n)(E/N_)  -  max  {p1^  (nEp /N T) } 
OiPil  3 

where  P  (•)  is  given  in  (3.26).  The  maximum  has  the  form 


(3.59) 


P^n) (E/N j) 


Ps(nE/Nj) 


■  < 


I  *M,n 
V  (e/Nj)11 


E/Nj 


<  «P, 


M,n 


E 


>  ®v. 

-  M,n 


(3.60) 


where  cm.  and  tjrw  are  constants. 

M,n  M,n 

For  BPSK  with  memory  m  =  1  we  can  use  binary  convolutional  codes  or 
repetition  codes.  The  error  probability  for  cases  of  hard  decisions  with  and 
without  side  information  are  calculated  in  the  same  way  as  for  M-arv  orthogonal 
modulation  so  we  do  not  repeat  the  calculations. 

With  BPSK  and  memory  m  >  1  we  consider  coding  using  codes  with  symbols 
size  larger  than  2.  The  method  we  use  to  exploit  the  channel's  memory  is  to 
treat  each  m  bit  as  one  symbol  in  a  code. 
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Table  3.4.  Constants  used  in  computing  symbol  error  probabilities  in  (3.61). 


m 

W 

m 

Z 

m 

Q(72zj 

m 

1 

0.0828 

0.7088 

.1169 

2 

0.1565 

0.7633 

.1083 

3 

0.2225 

0.8139 

.1010 

4 

0.2827 

0.8608 

.0947 

5 

0.3379 

0.9048 

.0897 

6 

0.3890 

0.9460 

.0845 

7 

0.4365 

0.9849 

.0802 

8 

0.4809 

1.0218 

.0767 

The  decoded  symbol  error  probability  can  be  computed  for  R-S  codes  by  using 

(3.61)  in  (2.42).  The  decoded  bit  error  prcbabilitv  P  , 

e,b 


is  then  given  by 
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Q(/2E/Nj) 


l-(l-Q(/2E7Nj)) 


—  P 
m  e,s 


e,b 


QC^ZJ 

m 


1-(1-Q(/2ZJ) 
is 


m  e,s 


e/nt  <  z 

J  m 


E/Nt  >  Z 
J  —  is 


(3.62) 


We  now  give  some  numerical  results  to  indicate  the  improvement  obtained 

by  using  codes  on  channels  with  partial-band  jamming.  We  will  be  interested 

in  the  average  bit  error  probability  P  for  a  specific  code  or  equivalently 

e,b  * 

the  necessary  to  obtain  a  certain  bit  error  rate.  Also  of  interest  is 

*  * 

the  worst  case  partial-band  jamming  strategy  p  .  Since  larger  p  means  the 
jammer's  optimum  strategy  is  to  jam  a  larger  band  this  might  be  a  costly 
strategy. 

First  we  give  numerical  results  for  the  channel  without  side  information 

and  hard  decisions.  We  give  results  for  M  =  32  (32-ary  orthogonal  signaling). 

-3  -5 

In  Table  3.5  the  E,/NT  necessary  for  bit  error  probability  10  and  10 

b  J 

are  shown  for  the  length  31  R-S  codes  when  used  on  this  channel.  Also  shown 
is  the  fraction  p  of  the  band  for  the  worst  case  partial-band  jamming 
strategy.  For  10  3  error  probability  the  (31,11)  RS  code  requires  least 

-3 

energy  E,  while  for  10  error  probability  the  (31,13)  code  requires  least 
b 

energy.  The  improvement  in  performance  obtained  by  the  (31,11)  code  in 
comparison  to  an  uncoded  system  is  35.1  dB  at  ^  =  10  3. 

The  dual  k  codes  performance  on  the  channel  with  hard  decisions,  no 
side  information  and  partial-band  jamming  is  shown  in  T_,.)le  3.6.  The  rate 
of  the  code  is  1 /v.  The  complexity  of  decoding  these  codes  in  terms  of 
storage  is  proportional  to  2  and  is  nearly  independent  of  v.  Notice  that 
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Table  3.5.  Performance  of  length  31  R-S  codes  on  channel  with  hard 
decisions,  no  side  information  and  partial-band  jamming 
(32-ary  orthogonal  signaling,  bounded  distance  decoding). 


P  -  10-3  P  .  «  10 

e,b  *  e,b 


Code 

Vnj  <dB> 

P 

V“j  (dB> 

P 

No  Coding 

20.50 

0.005 

40.50 

0.00005 

(31,29) 

14.35 

0.021 

24.57 

0.002 

(31,27) 

11.32 

0.046 

18.37 

0.009 

(31,25) 

9.43 

0.076 

14.58 

0.022 

(31,23) 

8.16 

0.111 

12.68 

0.039 

(31.21) 

7.26 

0.150 

11.13 

0.061 

(31,19) 

6.62 

0.196 

10.02 

0.088 

(31,17) 

6.19 

0.237 

9.23 

0.118 

(31,15) 

5.95 

0.283 

8.70 

0.151 

(31,13) 

5.84 

0.335 

8.38 

0.187 

(31,11) 

5.94 

0.388 

8.27 

0.226 

(31,9) 

6.26 

0.442 

8.41 

0.268 

(31,7) 

6.82 

0.497 

8.83 

0.313 

(31,5) 

7.79 

0.557 

9.68 

0.360 

(31,3) 

9.95 

0.618 

11.34 

0.410 

(31,1) 

13.90 

0.681 

15.56 

0.464 
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Table  3.6.  Performance  of  dual-3  codes  on  channel  with  hard  decisions, 

no  side  information  and  partial-band  jamming  (32-ary  orthogonal 
signaling) . 


V 

Vnj  (dB) 

P  <  10  3 

e.b  * 

P 

Vj  <dB) 

P  K  <  io"5 

e.b  * 

P 

1  (No  Coding) 

20.50 

0.005 

40.50 

0.00005 

2 

12.95 

0.055 

20.22 

0.010 

3 

8.93 

0.207 

13.32 

0.075 

4 

7.53 

0.381 

10.79 

0.180 

5 

6.97 

0.542 

9.44 

0.307 

6 

6.75 

0.684 

8.79 

0.428 

7 

6.71 

0.806 

8.44 

0.541 

8 

6.75 

0.912 

8.27 

0.643 

9 

6.85 

1.000 

8.20 

0.736 

10 

6.95 

1.000 

8.19 

0.819 

11 

7.05 

1.000 

8.22 

0.895 

12 

7.13 

1.000 

8.29 

0.963 

13 

7.22 

1.000 

8.35 

1.000 

14 

7.29 

1.000 

8.43 

1.000 

15 

7.36 

1.000 

8.49 

1.000 
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for  small  enough  rates,  the  worst  case  of  partial-band  jamming  strategy  is  in 

* 

fact  uniform  jamming  (p  =  1.0).  An  identical  conclusion  was  obtained  from 
capacity  and  cutoff  rate  considerations. 

Let  us  now  compare  the  performance  of  the  dual-k  and  R-S  codes.  In 

comparing  two  codes  we  must  keep  the  code  rates  the  same.  For  example  the 

dual-5  code  with  rate  *s(r  =  2)  requires  E,  /N_  =  20.22  dB  for  error  probability 

b  J 

10  The  (31,15)  R-S  code  with  rate  \  requires  only  8.7  dB.  The  rate 
l/3(r  =  3)  dual-5  code  requires  E^/N^  =  13.32  dB  for  error  probability  10  ^ 
while  the  (31,11)  R-S  code  requires  only  8.27  dB.  The  rate  1/10  dual-5  code 
requires  E,  /NT  =  3.19  dB  while  the  (31,3)  requires  11.34  dB.  The  comparisons 
made  include  not  only  the  code  under  consideration  but  also  the  decoding 
algorithm.  The  performance  of  the  dual-k  code  was  computed  assuming  maximum 
likelihood  decoding  (Viterbi  decoding)  while  the  performance  of  the  R-S  code 
was  computed  using  bounded  distance  decoding.  For  high  code  rates  bounded 
distance  decoding  is  nearly  maximum  likelihood.  However,  for  low  code  rates 
this  is  not  the  case.  For  example  the  (31,1)  R-S  code  is  actually  just  a 
repetition  code  of  length  31  and  is  capable  of  correcting  some  patterns  of 
29  errors  with  maximum  likelihood  decoding.  The  bounded  distance  decoder 
only  corrects  15  errors  and  no  more.  Thus,  on  the  channel  with  hard  decisions, 
partial-band  jamming  and  no  side  information,  for  low  code  rates  (<  1/S) 

R-S  codes  with  bounded  distance  decoding  become  inferior  to  dual-k  codes 
because  of  the  decoding  algorithm.  For  moderately  large  rates  (>  1/3)  R-S 
codes  with  bounded  distance  decoding  are  superior  to  dual-k  codes  with 
Viterbi  decoding. 
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For  comparison  purposes  we  can  bound  the  bit  error  probability  for 
R-S  codes  with  maximum  likelihood  decoding  (MLD)  by  using  the  union  bound 
[9,  eqns.  (1-28)  and  (2-22)].  The  performance  of  the  (31,5),  (31,3),  and 
(31,1)  codes  are  shown  in  Table  3.8.  As  can  be  seen  the  optimal  duty 
factor  p*  is  larger  when  using  MLD  than  for  bounded  distance  decoding. 
Although  MLD  is  not  currently  being  implemented  we  shall  see  later  that  by 
comgining  a  repetition  code  with  a  R-S  code  with  bounded  distance  decoding 
forces  the  duty  factor  to  one. 

The  performance  of  binary  convolutional  codes  with  Viterbi  decoding 

(MLD)  on  the  32-ary  channel  using  separate  codes  on  each  of  the  5  bits  in  a 

32-ary  symbol  can  be  calculated  using  (3.56),  (3.29),  (2.40)  and  (2.44)  with 

e  *»  P  .  We  consider  the  rate  h  constraint  length  7  and  9  convolutional 
b 

codes  in  [9,  Apnendix  B].  In  Table  3.9  we  indicate  the  performance  cc 
these  codes.  Notice  that  these  codes  are  inferior  to  the  (31,15)  RS  code 
with  bounded  distance  decoding.  Part  of  the  reason  for  this  is  that  binary 
convolutional  codes  with  32-ary  signaling  are  in  effect  interleaving  and 
so  when  side  information  is  not  present  this  interleaving  degrades  the 
performance.  Massey  [23]  considered  using  binary  convolutional  codes  on 
the  M-ary  pulse  position  inoculation  photon  channel.  That  channel  fits  the 
models  of  chapter  2  and  has  side  information  available  intrinsically. 

Massey  found  that  convolutional  codes  on  the  photon  channel  has  performance 
comparable  to  the  R-S  codes.  We  attribute  this  to  the  fact  that  side 
internation  was  available.  Without  side  information  R-S  codes  outperform 


convolutional  codes. 


Table  3.7.  Performance  of  R-S  codes  or  channel  with  hard  decisions 


no  side  information,  and  partial-band  jamming 

(32-ary  orthogonal  signaling,  maximum  likelihood  decoding) 


Code 

Eb/NJ(dB) 

P* 

VVdB) 

0* 

(31,5) 

6.89 

0.684 

7.81 

0.586 

(31,3) 

7.71 

0.945 

8.60 

0.771 

'  (31,1) 

10.61 

1.000 

11.76 

1.000 

P  .  <  10 
e.b 


-3 


P  .  <  10 
e.b 


-5 


C 

a 


« 


4 


Table  3.8.  Performance  of  binary  convolutional  codes  on  channel 
with  hard  decisions,  no  side  information  and  partial- 
band  jamming  (32-ary  orthogonal  signaling,  Viterbi 
decoding) . 


P  <  io"3 
e ,  o 


P  ,  <  10 
e.b 


Code 

Eb/NJ(d3) 

JU 

p 

VXJ(dB> 

JL 

K=7 

8.00 

0.171 

11.21 

0.082 

K=9 

6.44 

0.245 

9.36 

0.125 

4 
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We  consider  now  repetition  codes  on  the  channel  with  and  without  side 
information  with  hard  decisions  for  the  former  case  and  with  both  hard  and 
soft  decisions  for  the  latter  case.  The  case  of  32-ary  orthogonal 
signaling  and  BPSK  are  examined.  The  symbol  error  probability  for  hard 
decisions  without  side  information  is  given  in  (3.55)  with  P  =  P  (E/Nt) 
given  in  (3.29).  In  Table  3.9  the  performance  of  repetition  codes  of 
length  3  <  n  <  8  is  shown. 


Table  3.9-  Performance  of  length  n,  rate  1/n  repetition  codes  on  channel 

with  hard  decisions,  no  side  information  and  partial-band  jamming 
(32-ary  orthogonal  signaling) . 


n 

(dB) 

-3 

P  =10 

e,b 

* 

P 

y»j  (dB) 

P  ,  =  io~5 
e,b 

* 

P 

3 

13.21 

0.077 

23.24 

0.0077 

4 

10.43 

0.196 

18.55 

0.0301 

5 

9.18 

0.326 

15.28 

0.080 

6 

8.57 

0.451 

13.50 

0.145 

7 

8.26 

0.564 

12.40 

0.217 

8 

8.12 

0.666 

11.69 

0.293 

The  performance  of  repetition  codes  on  the  channel  with  side 
information,  hard  decisions  and  partial-band  jamming  is  shown  in  Table  3.10. 
In  Table  3*hLthe  corresponding  results  are  shown  for  soft  decisions.  Note 
that  soft  decisions  can  improve  the  performance  by  between  3  and  4  dB . 
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Table  3.10.  Performance  of  repetition  codes  on  channel  with  side  information, 
hard  decisions  and  partial-band  jamming  (32-ary  orthogonal 
signaling) . 


P  ,  »  10 
e,b 


-3 


P  .  =  10 

e,b 


-5 


Code 


Vj  (dB) 


Eb/S_,  <dB) 


(3,1) 

9.58 

0.264 

16.25 

0.057 

(4,1) 

8.36 

0.438 

13.36 

0.139 

(5,1) 

7.86 

0.604 

11.86 

0.240 

(6,1) 

7.70 

0.748 

11.04 

0.347 

(7,1) 

7.71 

0.868 

10.56 

0.449 

(8,1) 

7.79 

0.966 

10.29 

0.543 

Table  3.11.  Performance  of  repetition  codes  on  channel  with  side  information, 
soft  decisions  and  partial-band  jamming. 

,-3  „  ,«-5 


P  ,=10 
e,b 


P  .  -  10 

e,b 


Code 


VNJ  (dB) 


Eh/Nj  (dB) 


(3,1) 

6.59 

0.381 

13.25 

0.063 

(4,1) 

5.39 

0.493 

10.39 

0.156 

(5,1) 

4.87 

0.677 

8.87 

0.269 

(6,1) 

4.64 

0.838 

7.98 

0.389 

(7,1) 

4.58 

0.978 

7.44 

0.507 

(8,1) 

4.58 

1.000 

7.10 

0.619 
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We  plot  in  Figures  3.13-3.15  the  symbol  error  probability  for 
repetition  codes  of  length  1,3,5,  and  7  for  the  cases  of  i)  hard  decisions, 
no  side  information,  ii)  hard  decisions  with  side  information,  iii)  soft 
decisions  with  side  information.  Notice  that  with  hard  decisions  there  is 
an  optimal  diversity  or  code  length  such  that  for  fixed  E^/N^  the  symbol 
error  probability  is  minimized.  For  soft  decisions  with  side  information 
however,  the  symbol  error  probability  decreases  as  the  diversity  increases. 
We  will  see  in  the  next  chapter  that  this  is  not  true  when  there  is 
noncoherent  demodulation  and  soft  decisions.  Notice  also  that  for  soft 
decisions  with  n  large  the  optimum  duty  factor  is  one  so  that  partial- 
band  jammers  are  neutralized. 

These  repetition  codes  can  also  be  concatenated  with  Reed-Solomcn 
codes.  In  Tables  3.12-3.15  the  preformance  of  R-S  codes  when  used  in 
conjunction  with  repetition  codes  is  shown.  The  R-S  codes  were 

_3 

chosen  for  each  diversity  to  E^/N^.  for  bit  error  probability  10 


Code 

P  ,  =10 

Eb/Nj  (dB)  6’ 

P* 

(3,1) (31,17) 

7.12 

0.513 

(4,1) (31,21) 

6.57 

0.702 

(5,1) (31,21) 

6. 43 

0.895 

(6.1)  (31,21) 

6.61 

0.968 

(7,1) (31,23) 

6.70 

1.000 

Table  3.12.  Performance  of  repetition  codes  and  R-S  code  or. 

channel  with  hard  decisions  and  no  side  information 
(32-ary  orthogonal  signaling) . 
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Table  3.13. 

Code 

Performance  of  repetition  codes  and  R-S  code  on 

channel  with  hard  decisions  and  side  information 

(32-ary  orthogonal  signaling) . 

p  K-io”3 

e,b 

E^Nj  (dB)  p* 

(3,1)01,17) 

6.55 

0.966 

(4,1)(31,21) 

6.31 

1.000 

(5,1)01,21) 

6.45 

1.000 

(6,1)01,21) 

6.61 

1.000 

(7,1)01,23) 

6.69 

1.000 

Table  3.14. 

Performance  of  repetition  codes 

channel  with  soft  decisions  and 

(32-ary  orthogonal  signaling) . 

-3 

P  ,  =10 
e,b 

and  R-S  codes  on 

side  information 

Code 

Eb/Nj  (dB) 

p* 

(3,1)01,17) 

3.54 

1.000 

(4,1) (31,21) 

3.28 

1.000 

(5,1)01,21) 

3.28 

1.000 

(6,1)(31,21) 

3.28 

1.000 

(7 ,1) (31,23) 

3.26 

1.000 

* 


♦ 


% 


rnbahil  I  ty  for  repetition  codes  on  channel  witli 
and  side  Information  available  (32-nry  orthogonal  signaling) 
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rror  probability  for  repetition  codes  on  channels  with 

isions  and  side  information  available  (32-ary  orthogonal  eignalin; 


So  far  we  have  only  considered  the  case  of  memory  m  »  1  (i.e.  memoryless). 

The  case  of  memory  m  >  1  can  most  easily  be  examined  by  considering  BPSK 

with  hard  decisions  and  no  side  information.  The  symbol  error  probability 

for  a  symbol  consisting  of  m  bits  may  be  calculated  in  (3.61).  If  we  use  R-S 

codes  of  length  2m-l  then  the  decoded  symbol  error  probability  can  be 

calculated  using  (2.38).  The  bit  error  probability  is  found  by  using  (3.62). 

.In  Figure  3.16  the  bit  error  probability  for  the  (31,15)  and  (255,127)  RS 

codes  is  plotted  versus  E  /N  computed  using  (3.31a)  with  M  =  2.  The 

D  J 

performance  of  the  constraint  length  7  and  9,  rate  4  binary  convolutional 

codes  given  in  [  9,  Appendix  B]  with  full  interleaving  (m  =  1)  is  also  shown. 

Note  that  when  the  jammer  is  present  for  a  particular  symbol  the  uncoded 

bit  error  probability  is  Q(/2Z  )  independent  of  the  signal-to-noise  ratio  E/NT. 

m  J 

For  m  =  5,Q(/2Z  )  =  0.0892  while  for  m  =  8,Q(^2Z  )  =  0.0764.  From  Figure  3.16 
m  .  m 

we  see  that  the  convolutional  codes  perform  much  better  on  this  channel  relative 
to  the  R-S  codes  than  on  the  channel  of  Chapter  2.  This  is  due  to  the  fact 
that  the  bit  error  rate  when  the  jammer  is  on  is  very  low  (compared  to  h) • 
Although  we  expect  interleaving  to  hurt  the  performance  relative  to  uninterleaved 
systems,  the  memory  here  is  not  very  dominant.  In  the  example  of  Chapter  2 
the  error  probability  is  4  when  the  jammer  is  on  so  that  the  expected  number 
of  bit  errors  is  just  ^  m  or  2.5  for  m  =  5,  and  4  for  m  =  8.  While  for  the 
above  channel  the  expected  number  of  bit  errors  in  a  symbol  is  0.446  for  m  =  5 
*  8  so  that  most  symbol  errors  are  caused  by  single  bit  errors. 


and  0.611  for  m 
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CHAPTER  4 

CODING  FOR  CHANNELS  WITH  PARTIAL-BAND  JAMMING  AND  NONCOHERENT  DEMODULATION 
4.1  Introduction 

In  this  chapter  we  examine  the  performance  of  frequency-hopped  spread- 
spectrum  communication  system  subject  to  partial-band  jamming  with  noncoherent 
demodulation.  We  consider  M-ary  orthogonal  signals  with  frequency  shift  keying 
on  multiple  frequency  shift  keying  (MFSK) .  The  modulated  signal  is  frequency 
hopped  to  produce  the  transmitted  signal.  The  received  signal  is  dehopped  and 
then  demodulated  to  produce  the  channel  output.  The  jammer  adds  noise  to  the 
signal  only  over  a  fraction  of  the  frequency  band  the  transmitter  is  using. 

The  strategy  of  the  jammer  corresponds  to  the  fraction  of  the  band  that  is 
jammed.  We  will  consider  the  performance  for  the  worst  case  jamming  strategy. 

The  remainder  of  the  chapter  is  divided  into  four  sections.  In  Section  4.2 
the  channel  models  will  be  described  for  MFSK  with  noncoherent  demodulation. 

We  will  consider  the  MFjK  for  M-ary  orthogonal  signals  to  simplify  the  descrip¬ 
tion.  The  capacity  for  the  channel  described  in  Section  4.2  is  computed  in 
Section  4.3  with  and  without  side  information  available  at  the  channel  output. 

In  Section  4.4  we  repeat  the  calculations  for  the  cutoff  rate.  In  Section 
4.5  the  performance  of  specific  codes  is  evaluated  when  side  information  is 
and  is  not  available.  We  compare  the  coded  performance  to  the  channel 


capacity  and  cutoff  rate. 
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4.2  Channel  Models 

In  this  section  the  channel  models  for  frequency-hopped  spread-spectrum 
communication  using  MFSK  are  given  when  there  is  partial-band  jamming.  As 
mentioned  in  Chapter  1  we  treat  the  frequency  hopper  and  dehopper  as  performing 
inverse  operations  on  the  modulated  signal.  The  output  of  the  frequency 
dehopper  consists  of  two  additive  terms.  The  first  term  corresponds  to  the 
received  signal  in  the  absence  of  noise,  while  the  second  term  is  due  to  the 
jammer's  signal.  This  second  term  is  nonzero  only  if  there  was  a  jamming 
signal  in  the  band  that  the  MFSK  signal  was  transmitted  in.  This  band  includes 
the  frequencies  of  all  possible  MFSK  signals  the  modulator  produces. 

Consider  frequency  hopping  with  m  symbols  per  hop.  Since  as  in  Chapter  3 
we  assume  the  channel  is  memoryless  from  hop  to  hop  describing  the  channel  for 
a  single  hop  is  sufficient  to  desr  ^e  the  channel.  For  MFSK  the  input 
alphabet  A  =  {0,1, . . . ,M-1}  .  Assume  that  the  particular  hop  begins  at  time 
t  =  0  and  is  of  duration  mT  where  T  is  the  duration  of  one  MFSK  signal.  When 
the  input  ,  0  <  j  <  m,  takes  the  value  i  €  A,  the  data  modulated  signal 
s^(t-jT)  is  the  input  to  the  frequency  hopper  during  the  interval  jT  S  t  S  (j-l)T. 
The  signal  s^(t)  is  given  by 

s.(t)  ®  /IP  cos(uj.t  +  8  ,)p  (t)  (j-l)T  <  t  <  jT  (4.1) 

i  i  i  x 

where  uj^,  0  <  i  <  M,  is  the  radian  frequency  of  the  signal,  P  is  the  power 
and  T  is  the  duration.  (We  assume  throughout  that  {s.(t)},  c  forms  an 
orthogonal  signal  set.)  In  (4.1)  9  ,  0  <  i  M-l  is  the  phase  of  the  i-th 
signal.  The  frequency  hopper  changes  the  center  frequency  of  the  modulated 
signal  in  different  hops  to  one  of  q  different  center  frequencies  according 


to  a  specified  hopping  to  produce  the  transmitted  signal  s^t-jT)  during 
the  interval  jT  <  t  <  (j+l)T,  0  <  j  <  m,  given  by 

s^t)  =  pT(t)cos(u)i  +  cui)t  +  cpi)  (4.2) 

where  1  <  i  <  q  are  the  q  different  center  frequencies  of  the  hopping 
pattern. 

The  model  for  the  jamming  signal  is  the  same  as  in  Chapter  3  so  we  do 
riot  repeat  the  descriptions  here. 

The  received  signal  r(t)  when  s^(t-jT),  0  ^  j  <  m,  is  transmitted 
consists  of  the  sum  of  the  transmitted  signal  and  the  jamming  signal: 

r(t)  =  s.  (t-jT)  +  j  (t) ,  jT<t<(j+l)T  .  (4.3) 

(Here  we  assume  without  loss  of  generality  that  all  time  delays  are  zero.) 

The  frequency  dehopper  changes  the  center  frequency  of  the  received  signal 
according  to  the  hopping  pattern  of  the  transmitter.  A  possible  random 
phase  shift  is  also  introduced.  The  signal  r(t)  at  th  '  output  of  the 
frequency  dehopper  is  then  given  by 

r(t)  =  \/2P  cosOiKt  +  oi)pT(t)+j^(t)  (j-l)T  <  t  <  jT  (4.4) 

a 

where  j  ( c )  is  the  bandpass  process  obtained  from  when  j(t)  is  frequency 
X 

translated  by  and  then  filtered  by  an  ideal  bandpass  filter  with  center 

frequency  x.  and  bandwidth  2a:  .  The  bandwidth  >x  is  chosen  large  enough 
so  that  each  of  the  MFSK  signals  is  essentially  unaltered  when  filtered 
by  this  bandpass  filter.  Also  in  (4.4)  ~  is  a  random  phase  which  accounts 


for  the  phase  introduced  by  the  frequency  hopper,  dehopper,  and  any 
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The  demodulator  we  consider  processes  the  received  signal  r(t)  by 
computing  the  M-dimensional  vector  Y^  ■  (Y.  .,Y«,  Yw  .  .)  where 


/a  ytr/J11  *  \2  rJT  -  \2t 

-i  ‘(v)  vdt )  +({J-DTr(t)sl,,"itdt)] 


0  <  1  <  M-l 


(4.5) 


The  density  p(yfc  j  |x  ■  i,Z  *  1/p  )  of  Y^  ^  given  Xj  *  i  and  the  jammer  is  on 
can  be  shown  to  be  given  by 


P(yk,jlX  =  i’Z  =  1/p)  "  I 


7k,J*xpt'%(7k,J+p2>)l0(Pyk,J)  •  k‘1 


(4.6) 


1  ykjexP^-^  ykjj^  »  k  ^  i 


where  8  *  2PT/NjZ  ■  2  E/N^Z  and  is  defined  as  the  energy  per  transmitted 
symbol.  When  the  jammer  is  off  (Z  *  0)  we  have 

PtYjj  -  V2  E/Nj  k|Xj  =  i,Z  -  0]  *  1  (4.7) 

where  ,  is  1  for  k  =  i  and  zero  otherwise. 
i,k 

Note  that  the  receiver  can  tell  given  Y,  .  whether  or  not  the  jammer 

J 

was  on  during  the  hop  by  checking  if  Y,  .  = >J2  E/N  6,  ,  for  some  i  so  that 

R,  j  J  4 ,1C 

side  information  is  available.  However,  the  receiver  might  just  decide 
that  s.  was  transmitted  in  [(j-l)T,jT]  if  Y,  .  >  Y,  ,  k  #  i.  In  this  case 

*  ,  J  K.,  J 

the  receiver  makes  a  hard  decision  and  disregards  the  side  information. 
Alternatively  the  receiver  may  knew  which  hops  were  jammed  and  make  hard 
decisions.  In  the  next  section  we  compute  the  capacity  of  the  partial-band 
noise  jamming  channel  for  the  cases  stated  above. 


a 
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4.3  Channel  Capacity 

In  this  section  we  derive  expressions  for  the  capacity  of  frequency 
hopped  MFSK  with  partial-band  jamming.  We  compare  this  to  the  capacity 
when  the  jammer  corrupts  the  entire  frequency  band  of  the  system  (p  »  1) . 

We  conclude  that  provided  codes  of  rate  smaller  than  some  critical  rate  are 
used,  p  *  1  is  the  worst  case  partial-band  jamning  threat. 

We  treat  the  case  of  the  receiver  having  side  information  first.  When 
the  jammer  is  on  the  channel  is  a  M-ary  FSK  additive  Gaussian  noise  channel 
with  signal  energy- to-noise  ratio  2Ep/NT.  The  capacity  Cu(Ep/N_)  of  this 
component  channel  is  achieved  with  a  uniform  input  distribution  on  A.  When 
the  jammer  Is  off  the  component  channel  is  a  M-ary  symmetric  channel  with 
error  probability  zero  and  capacity  (measured  in  M-ary  symbols  per  channel 
use)  equal  to  1.0.  Thus  both  component  channels  have  the  same  input 
distribution  that  achieves  capacity.  In  this  case  from  (2.18)  the  capacity 
of  the  composite  channel  is  independent  of  the  memory  length  m  of  the  channel. 
The  capacity  C(E/Nj)  for  M-ary  FSK  with  worst  case  partial-band  jamming  is 
given  by 

)  =*  min  Cp  C  (Ep/NT)  +  (1-p)}  .  (4.8) 

0  <  p  <  1  n  J 

The  minimum  in  (4.8)  can  be  found  numerically  or  by  setting  the  first 
derivative  equal  to  zero; 

|r  Cp  ^(ep/Nj)  +  (i  -p)3  «  o 

or 

Cm(Ep/Nj)  +  Ec/Nj  (^(Ec/Nj)  =  1 


VE/N 


(4.9) 
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where  C'(x)  ■  3C (x)/3x  .  From  (4.9)  we  can  deCerolne  the  dependence  of  the 
worst  case  p  ■  p*  on  the  signal- to-noise  ratio  E/N.  as 

J 


1  I/*,  <  VM 


E/NJ  2  YM 


(4.10) 


where  y».  Is  the  solution  of 


W  *  V«(V  * 1 


(4.11) 


Using  (4.10)  in  (4.8)  we  obtain 


VE/V 


(^(E/Nj) 


E/NJ  <  YM 


Ym  -  YMCM(YM) 

1  .  -i* _ SUl  v  /w  >  v 

e/nt  f/nj  *  ym 


(4.12) 


If  codes  of  rate  r  (measured  in  M-ary  units)  are  used  then  reliable 
communication  is  possible  provided  r  <  C(E/N  )  (see  Theorem  2,  Chapter  2) 

J 

In  the  case  E/N^  >  reliable  comnunication  is  possible  provided 


r  <  1  - 


ym  -  ymcm(ym> 


.....  _ym'ymcm(V  Vl-W> 

>  -  (1-r) - 


(4.13) 


Since  E  is  the  energy  per  transmitted  signal  and  log^M  bits  are  transmitted 
per  signal  the  energy  per  information  bit  with  code  of  rate  r  is 


Eb/Nj  -  (E/NjJ/r  log2M 


so  that  (4.13)  becomes 


Vsj 


log2M(l-r)r 


(4, 


We  wish  to  choose  the  code  rate  that  minimizes  the  right  hand  side  of 
(4.14).  The  minimum  can  easily  be  shown  to  occur  at  r  *  r*  *  %.  Thus  for 
the  optimal  code  rate  we  need 


Eb/!,j 


log2M 


(4, 


This  holds  provided  E/Nt  >  yw  or  equivalently  C„(Y„)  <  Note  that  so  far 

J  M  MM 

we  have  not  specified  the  type  of  receiver  (e.g.  hard  decisions,  soft 

decisions).  For  a  particular  receiver  structure  we  need  only  compute  (^(x) 

and  C'(x)  to  solve  (4.11).  Notice  from  (4.10)  that  provided  E/N_  <  y.,  or 
M  J  M 

equivalently  C^(E/Nj)  <  the  worst  case  partial-band  jamming  strategy 
is  in  fact  uniform  jamming. 

For  binary  FSK  with  soft  decisions  (so  side  information  is  available) 
C2(x)  has  been  computed  [ 5  ]  as 

•  « 

C2(x)  *  expt-x  ]  J  y0yx  exp£-  %  (Yq +  y1)}lQ(2xy) 

f  2I0(2xy0)  *1 

•  l0*  |l0(2xy0)+I0(2xyi)J  dV*l  (4 

We  can  also  compute  C^Cx)  by  differentiating  (4.15)  for  soft  decisions  with 


binary  FSK  and  partial-band  jamming 


C(E/Nj) 

E/Nj  <  2.4137 

C2(E/Nj)  « 

(4.17) 

.  1.1741 

u'  «*, 

E/Nj  i  2.4137  . 

Notice  in  this  case  y^  ■  2.4137  and  Cfr^)  ”  0.51359  >  0.5  so  that  (4.14)  is 
not  valid.  The  optimal  code  rate  in  this  case  can  be  found  numerically  to  be 
approximately  0.48. 

A 

For  M-ary  FSK  with  hard-  decisions  the  capacity  (^(x)  is  given  by  (3.27) 

with  P  replaced  by  P  (E/N_)  given  by 

S  J 


VE/V 


1  M  i  u 

=  2  (-1)JC)  exp(-  E/N,(l-l/j)}  . 

M  j-2  J  J 


(4.18) 


For  partial-band  jamuing  with  side  information  available  and  hard  decisions 
the  capacity  (^(E/Nj.)  can  be  computed  using  (4.8)-(4.12)  as 


cm(psCe/Nj» 


e/nj  <  •'m 


Ve/sj> 


(4.19) 


,  Vm  * 

*  “  M 


E/NJ  4 


where  y  i»  a  constant.  In  Table  4.1  we  list  the  values  of  y__  and  C  (yw) 

ci  M  M  M 

for  M  *  2,4,8,16  and  32.  Notice  that  C^(y^)  <  \  so  that  the  optimal  code 
rate  for  these  cases  is  r  * 

When  side  information  is  not  available  the  capacity  depends  on  the 


memory  length  of  the  channel.  For  m  ■  1  the  channel  is  a  memoryless  MS C  with 
symbol  error  probability  given  by  the  average  of  the  error  probabilities  of  the 
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component  channels.  Since  capacity  is  a  decreasing  function  of  the  symbol 
error  probability  maximizing  symbol  error  probability  is  equivalent  to 
minimizing  capacity.  The  maximum  of  the  average  error  probability  P  (E/N_) 
has  been  computed  [IS]  as 

P  (E/N.)  -  max  (p  Pfi(Ep/N.)} 

J  0  <  p  <  1  J 

f  VE/HJ>  '  E/NJ  < 

(4.20) 

E/NJ  2  Si 

The  capacity  is  found  using  (3.27)  with  P  =  P  (E/Nt)  given  in  (4.20). 

S  J 

Thus  the  capacity  C  (E/N  )  with  no  side  information  is  given  by 

M  J 


wv 


E/N, 


^,(Pa(E/Nj)) 

C„  (V,V> 


E/Hj  <  V 
E/NJ  2  Si 


(4.21) 


The  values  of  P^X^)  and  are  given  in  Table  4.1. 


Table  4.1.  Values  of  constants  used  to  determine  capacity  for  M-ary  FSK. 


M 

W 

W 

W 

2 

3.0169 

0.4982 

2.0000 

0.1839 

0.3114 

4 

3.275 

0.4878 

2.3830 

0.2933 

0.3311 

8 

3.6610 

0.4721 

2.7821 

0.3687 

0.3384 

16 

4.0152 

0.4540 

3.1924 

0.4259 

0.3380 

32 

4.3882 

0.4354 

3.6132 

0.4715 

0.3333 
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To  interpret  these  results  we  plot  die  E^/N^  needed  to  achieve  capacity 
(see  3.31b). 

For  soft  decisions  binary  FSK  the  capacity  is  given  in  (4.17).  In 
Figure  4.1  we  plot  E^/Nj  needed  to  achieve  capacity.  This  is  compared  to 
the  needed  to  achieve  capacity  for  uniform  janming.  For  rates  less 

than  0.513  uniform  jamming  is  the  optimal  partial-band  jamming  strategy. 
Notice  the  increase  in  E^/Nj.  necessary  for  reliable  communications 
for  low  rates.  This  did  not  happen  for  BPSK  with  soft  decisions. 

We  explain  this  increase  as  the  noncoherent  combining  loss  encountered 
when  the  receiver  does  not  demodulate  the  transmitted  signal  coherently 
and  the  code  rates  are  small. 


For  hard  decisions  M-ary  FSK  with  and  without  side  information  the 
E^/Nj  needed  for  reliable  communications  is  shown  in  Figures  4. 2-4.6  for 
M  ■  2,4,8,16,  and  32,  The  rates  below  which  uniform  jamming  is  optimal 
are  given  in  Table  4.1.  These  curves  are  for  the  case  of  m  *  1.  In 
Figure  4.2  we  also  plot  the  E^/Nj  necessary  for  reliable  communication 
when  m  >  1. 


For  m  >  1  the  capacity  is  given  by  (2.35)  with  «  ■  p  and  a  ,  given  by 

nijK 


(l-p)  +  p(l-*Ee 


-Ep/2N. 


k  -  0 


(4.22) 


E=/2V„  ,  "Ep  /2Nj  m-k  t  ,  , 

P (h  e  )  (1-^e  )  k  *  1,2, . ..,m 


The  minimum  in  (2.35)  no  longer  has  the  simple  inverse  linear  relation  for 
the  case  m  *  1. 


4 


Partial-band  jamming 


needed  to  achieve  capacity  for  binary  FSK  with  soft  decisions 
rlial-band  jamming  (side  information  available). 


Partial -band  jamming 
No  aide  information 


achieve  capacity  for  binary  FSK  with  hard  decisions 


Partial-band  jamming 
With  side  information 


needed  to  achieve  capacity  for  8-ary  FSK  with  partial-band 


I  needed  to  achieve  capacity  for  16-ary  FSK  with  hard  decisions 
partial-band  jamming. 


Partial -hand  jamming 
With  side  information 


needed  to  achieve  capacity  Foe  32-ary  FSK  with  hard  decisions 
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In  Section  4.5  we  compare  the  system  performance  based  on  capacity 
calculation  to  the  performance  based  on  error  probability  for  specific 
codes . 

4.4  Channel  Cutoff  Rate 

In  this  section  we  derive  expressions  for  the  computational  cutoff  rate 
for  channels  with  partial-band  jamming  and  noncoherent  demodulation.  Many 
of  these  results  have  appeared  in  the  literature  (4],  [8],  [42]  for 
memory less  channels  (m  =  1).  We  repeat  these  calculations  for  completeness 
and  also  treat  the  case  of  memory  m  >  1. 

Consider  first  the  case  of  side  information  available.  From  (2.28)  the 
cutoff  rate  with  side  information  and  memory  m  is  given  by 

RQ(m)  =  -  ^  log^[jm(S)}  (4.23) 

where 

’R0  s 

J(s)  =  M  U,S  (4.24) 

and  Rq  g  is  the  cutoff  rate  of  the  component  channels  Ag . 

The  necessary  assumption  for  the  validity  of  (4.23)  and  (4.24)  that  the 
input  distribution  that  achieves  Rq  g  is  the  same  for  all  component  channels 
will  be  true  for  all  channels  considered. 

When  the  jammer  is  on  the  channel  it  is  an  M-ary  FSK  additive  Gaussian 
noise  channel  with  signal  energy-to-noise  ratio  2Ep/N  .  The  cutoff  rate 

J 

R_  (Ec/N_)  of  this  component  channel  is  achieved  with  a  uniform  input 

w  j»l  J 

distribution  on  A.  When  the  jammer  is  off  the  channel  it  is  a  noiseless  MSC 
with  cutoff  rate  (measured  in  M-ary  units)  1  achieved  by  a  uniform  input 
distribution.  The  cutoff  rate  of  the  composite  channel  is  then 


where 


*o!m(E/NJ>  "  ’  m  lo®2  C3M(E/NJ>3 


J^CE/Nj)  -  o<max<  +  <1-PKS)B3 


and  J„  (x)  »  M 
Itt 


.  The  maximum  in  (4 .26)  can  be  found  by  setting  the 


derivative  equal  to  zero: 


where  a„  *  Ep/N_  and  J'(x)  =  3Jw(x)/dx.  The  value  of  that  satisfies 

j  M  N 

(4.27)  determines  the  worst  case  p  *  p  : 


* 

P  * 


E/N.  <  c  m 
J  M,m 


M,m 

E/Nt 


E/N.  *  <?M  _ 
J  M,m 


Using  (4.28)  in  (4.25)  yields 


jm”)<e/V  - 


Jm(e/Nj) 


.l.m  .M?m 

vr  E/Nj 


E/NJ  *  ffM,« 


E/S.  ?  c„ 
J 


where  Z  =  c  )  -  M  mc..  and  thus  R.^,  can  be  found  using 

M,m  M,m  Mv  M,my  M,m  0,M  5 

(4.23)  in  (4.25).  Notice  from  (4.28)  for  E/Nt  the  worst  case  jarnning 
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t 


m 


strategy  Is  uniform  jamming.  Using  (4.29)  in  (4.25)  we  obtain 


‘  R0,M^N.P 


(l  +  M^Z  ) 
■  .  x  ,  m.m 

V  1  '  m  l0% - 


E/NJ  < 


(4.30) 


E/N, 


E/BJ  =*  °M,m 


the  constants  and  ou  depend  on  the  type  of  receiver  (e.g.  hard 

MjHi  M,m 

decisions  and  soft  decisions). 

For  soft  decisions  Jm(x)  can  be  computed  to  be  [16] 


CD 

1  +  (M-l)e‘X[J  te‘t2/2I*  (tv^)dt]2 


Jm<X> 


M 


(4.31) 


For  m=l  it  is  easy  to  check  that  the  maximization  in  (4.26)  is  independent 
of  M.  For  m=l  the  cutoff  rate  with  soft  decisions  and  side  information  is 
(measured  in  M-ary  units) 


ao>/Nj> 


E/Nj.  <  2.871 


=  \ 


(4.32) 


-  W1  *  *&™**>* 


E/Nj  s  2.871  . 


For  hard  decisions  J^Cx)  is  given  by  [16] 


rM-2 


J_00 

m 


1  +  (M-D[^Y  Ps<x>  +  VPs(x)(l-Ps(x))/(M-l)  ] 

— 


(4.33) 
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where  P  (x)  is  given  in  (4.18).  In  Table  4.2  the  constants  used  to  evaluate 
s 

the  cutoff  rate  with  side  information  are  given  for  m  ■  1  and  M  *  2,4,8,16 
and  32. 

Table  4.2.  Constants  for  M-ary  hard  decision  cutoff  rate. 


M 

°M,1 

^,1 

2 

4.268 

1.007 

4 

4.244 

1.502 

8 

4.245 

1.825 

16 

4.314 

2.063 

32 

4.460 

2.291 

U 


For  hard  decisions  without  side  information  and  m  »  1  the  jammer  just 
maximizes  the  symbol  error  probability.  For  m  >  1  we  can  use  (2.31)  to 
compute  the  cutoff  rate  with  ^  given  in  (4.22). 

We  plot  in  Figure  4.7  the  E^/Nj.  needed  to  achieve  Rq  for  binary  FSK 
with  soft  decisions.  Both  partial-band  and  uniform  jamming  are  shown.  In 
Figure  4.8  the  E^/Nj  needed  is  shown  for  binary  FSK  with  hard  decisions. 

Both  uniform  and  partial-band  jamming  are  shown  as  well  as  both  cases  of 
side  information  available.  Finally  in  Figure  4.9  the  corresponding  results 
are  shown  for  32-ary  FSK.  We  note  here  that  (4.32)  is  similar  to  an  expression 
obtained  by  Viterbi  [43]  and  Otnura  and  Levitt  [31].  However,  both  of  these 
papers  considered  soft  decisions  with  square  law  combining  (a  suboptimum 
receiver).  Here  we  consider  the  optimum  receiver  to  obtain  (4.32).  The  form 
of  the  expressions  are  identical  with  1.424  replaced  by  1.4713. 


I 


Partial-band  jamming 


to  achieve  cutoff  rate  binary  FSK  with  soft  decisions 
!ind  jamming. 


Part  In  l -hand  jamming 
With  side  Information 


needed  to  achieve  cutoff  rate  for  binary  FSK  with 


Figure  4.9.  F.  /N  needed  to  achieve  cutoff  rate  for  32-ary  FSK  with 

D 

partial-hand  Jamming. 
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4.5  Performance  of  Codes 

In  this  section  we  examine  the  performance  of  codes  on  channels  with 

partial-band  jamming.  We  consider  the  same  codes  as  in  Chapter  3. 

Consider  first  hard  decisions  with  32-ary  FSK.  The  symbol  error 

probability  has  the  exact  same  form  for  noncoherent  detection  as  for  coherent 

* 

detection  when  the  optimal  duty  factor  p  is  less  than  one.  In  fact  when 

p  <  l.the  decoded  bit  error  probabilities  are  the  same  if  for  noncoherent 

we  add  1.96  dB  to  the  tables  in  Chapter  3.  However  we  must  check 

always  that  p  <  1.  In  Table  4.3  we  give  the  bit  energy-to-average  noise 

-3  -5 

density  required  for  10  and  10  bit  error  rates  with  length  31  R-S 

codes  and  in  Table  4.4  the  corresponding  curves  for  dual-k  codes. 

From  capacity  calculation  we  see  that  at  rate  13/31“. 42  we  need 

E^/Nj“3.2  dB  for  reliable  communication.  From  cuttoff  rate  calculations 

this  is  increased  to  E^/Nj-S.OdB.  From  Table  4.3  we  see  that  for  error 

probability  10  ^  we  need  E^/Nj“7.8  dB  for  R-S  codes,  4.6  dB  more  than  what  the 

channel  capacity  says  and  1.2  less  than  what  the  cutoff  rate  indicates. 

-3 

We  note  that  the  optimal  R-S  code  for  10  error  probability  has  rate  0.42 
while  for  10  ^  the  optimal  R-S  code  has  rate  0.35.  The  optimal  rate  from 
capacity  considerations  is  0.43  and  from  cutoff  rate  considerations  is 

0.191.  The  optimal  rates  for  dual  k  codes  are  much  less  than  R-S  codes. 

-3  -5 

For  10  error  probability  the  rate  1/7=0.14  is  optimal  while  for  10  error 

probability  the  optimal  rate  is  1/10=0.1  which  are  much  less  than  predicted 

from  capacity  considerations  and  slightly  less  than  that  predicted  from  the 

cutoff  rate. 

Consider  now  the  symbol  error  probability  for  repetition  codes  with 
and  without  side  information.  When  side  information  is  not  available  the 


Table  4.3.  Performance  of  length  31  R-S  codes  with  bounded  distance 
decoding,  no  side  Information  and  partial-band  j  aiming 
(32-ary  FSK). 


uncoded  symbol  error  probability  is  calculated  using  (4.20).  With 

coding  the  symbol  error  probability  is  calculated  using  (3.55).  This 

is  plotted  in  Figure  4.10  for  n*l,3,5,7.  When  side  information  is 

available  then  the  symbol  error  probability  has  the  form  of  (3.58)  with 

different  constants  and  P  given  in  (4.18).  This  is  plotted  in  Figure 

s 

4.11.  With  soft  decisions  and  side  information  available  the  error 
probability  for  square-law  combining  has  been  calculated  (40].  This  is 
shown  in  Figure  4.12.  Although  square-law  combining  is  not  optimal,  for 
low  signal-to-noise  ratios  it  is  nearly  optimal.  With  partial -band  jamming 
the  signal-to-noise  ratio  when  jammed  is  typically  very  small  so  we 
expect  that  square-law  combining  is  nearly  optimal.  In  comparing 
Figures  4.12  and  3.15  we  see  that  with  noncoherent  reception  the  optimal 
code  rate  depends  on  the  E^/N^  whereas  for  coherent  reception  the  optimal 
rate  is  the  smallest  rate. 


Symbol  error  probability  for  repetition  codes  on  channel  with  hard 
decisions  and  no  side  information  (32 -ary  FSK). 


>1  error  probabilities  for  repetition  codes  on  channel 
decisions  and  6ide  information  available  (32-ary  FSK) 


probability  for  repetition  codes  on  channel  w 
s  and  side  information  available  (32-ary  FSK) 


CHAPTER  5 


SUMMARY  AND  CONCLUSIONS 

In  this  thesis  we  have  examined  the  performance  of  codes  on  channels 
with  partial -band  interference  and  frequency-hopping.  The  capacity, 
cutoff  rate  and  channel  capacity  were  all  considered  as  performance 
measures.  In  Chapter  2  it  is  shown  that  the  capacity  is  a  better  para¬ 
meter  to  characterize  the  performance  of  a  channel  than  the  cutoff  rate. 
Comparisons  between  burst-error  correcting  codes  and  random-error  correcting 
codes  with  interleaving  showed  that  the  later  performed  comparably  to  the 
former  only  in  the  case  of  side  information  available.  Without  side 
information  burst-error  correcting  codes  perform  better. 

We  examined  extensively  two  types  of  demodulation  for  channels  with 
partial-band  jamming,  namely  coherent  and  noncoherent.  We  made  the 
assumption  that  there  was  no  background  noise  In  the  channel.  The 
assumption  is  easily  relaxed.  The  forms  of  nearly  all  expressions  are 
modified  slightly  when  there  is  some  background  noise.  For  example,  the 
maximum  symbol  error  probability  for  M-ary  orthogonal  signaling  given  in 
(3.29)  with  background  noise  and  worst  case  partial-band  jamming  becomes 

Ps(E/(W>  E/NJ  <  VE/V 

L(e/n  ) 

VE/V  +  '  e/nT-"  E/NJ >  VE/V 

J 

"here  A^  and  depend  only  on  E/Nq,  the  signal-to-background  noise 
ratio.  As  E/Nq  -*■  «  ,  X^(E/Nq)  ■+■  X^  given  in  (3.29).  Similar  results  can 
be  derived  for  the  capacity  and  cutoff  rate.  These  results  can  also  be 
extended  to  include  fading  and  jamming  together.  In  many  cases  with  fading 


it  turns  out  that  the  optimum  partial-band  jamming  strategy  is  uniform 
or  broad  band  jamming.  For  Rician  fading  this  is  true  only  for  certain 
“ranges  of  the  parameter  characterizing  the  fraction  of  transmitted  energy 
.that  is  faded.  In  the  other  range  the  worst  case  jamming  strategy  has 
the  same:form  as  in  the  nonfaded  channel.  What  we  try  to  indicate  is  that 
the  channel  models  we  are  employing  are  quite  general  and  applicable  to  a 
wide  variety  of  communication  systems. 

For  channels  with  partial-band  interference  we  evaluated  the  perfor¬ 
mance  of  several  codes.  We  considered  both  block  and  convolutional  codes, 
hard  and  soft  decisions  and  .channels  with  and  without  side  information. 

We  conclude  that  good  coding  schemes  exist  for  channels  with  partial-band 
interference  and  are  essential  for  reliable  communications. 
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APPENDIX  A:  DERIVATION  OF  CAPACITY,  RANDOM  CODING  EXPONENT  , 

AND  CUTOFF  RATE  FOR  CHANNELS  WITH  MEMORY 
In  this  appendix  we  derive  (2.22),  (2.24),  and  (2.29)-(2.32) .  LetA 

8 

be  an  M-ary  symmetric  channel  with  crossover  probability  s/(M-l)  so  that 
the  symbol  error  probability  is  s.  Let  P  be  a  distribution  on  the  random 
variable  S.  Here  we  normalize  the  information  rates  by  measuring  in 
M-ary  symbols  per  channel  use  so  that  the  capacity  is  less  than  1. 

First  consider  the  capacity  C^(m)  without  side  information  available. 
From  (2.16)  this  is  given  by 

C^(m)  -  max  ^  I(X;Y)  (A.l) 


where  X  =  (X.  ,X- , . . .  ,X  ),  Y  ■  (Y. ,Y~ , . . . ,Y  )  and  the  maximum  is  over  all 
—  jl  ^  m  —  i  z  m 

distributions  on  the  vector  X.  The  maximum  in  (A.l)  is  obtained  by  the 

uniform  distribution  for  all  channels  A  so  that  (A.l)  can  be  written  as 

s 


i  ,  p(z!*> 

CM(m)  "  m  *  *  P(2l*)P<*>lo8M 


m 


Z  Z  p(i|x)log>I 
I  x 


p(z|x) 


M 


-m 


(A. 2) 


(A. 3) 


That  p(y)  =  M  m  is  due  to  the  fact  that  the  channel  is  symmetric  and  that 
p(x)  *  M  m.  From  (A. 3)  we  have 


Vm)  =  z  E  p^lxHiog^"”  +  logn  p(z|x)) 

vx 

M"m 

=  1  +  Z  Z  p(vjx)  log  P  (v!x)  • 

V  X  M 


(A  .4) 
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The  sum  over  X  in  (A. 4)  can  be  decomposed  into  two  sums  as 

m 

I  *  I  I 
x  k*0  xid(x,jr)«k 

The  second  sum  is  over  all  vectors  x  which  are  distance  k  from  The 
distance  measure  here  is  the  Hamming  distance  (i.e.  d(x,£)  is  equal  to  the 
number  of  components  in  which  x  and  £  differ).  If  x  and  %  differ  in  k 
places  then  k  channel  errors  have  occurred  so  that 

<*mjk  A  P(zls>  *  E(<S/(M-l))k(l-S)m"k]  ;  S(xor)  *  k  .  (A.5) 

Notice  that  (A.5)  depends  only  on  k  and  not  on  the  specific  x  and  For  £ 

fixed,  the  number  of  vectors  x  such  that  d(x,£)  =  k  is  just  (^)(M-l)k  so 
that  (A. 4)  becomes 


V">  *  1  +  S  J,  (“H*-1*  Vkl0V«A 


(A. 6) 


which  for  M  =  2  is  (2.22). 

When  side  information  is  available  the  capacity  C^(m)  is  given  by 

CM(m)  =  E{C^(S)}  (A. 7) 

where  C^(x)  is  the  capacity  of  an  M-ary  symmetric  channel  with  symbol  error 
probability  x  and  is  given  by 

CM(x)  ■  1  +  (l-xjlog^l-x)  +  x  log>I(x/(M-l))  (A. 8) 


For  M-2  (A. 7)  and  (A. 8)  yield  (2.24). 
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Next  consider  the  random  coding  exponent  defined  In  (2.26)  for  these 


channels.  For  no  side  Information  available  the  random  coding  exponent  Is 
E^’^CP.Q*)  Is 


m  l0*M' 


_k  .Up 


’■“'(P.Q*)  »  -  j  j  1 

-  -  ;  H‘"<1+C)f  £  P(zl2)l4p  1 

\l  L  k*°  x:d(2£»2>mk  -1 

{Pm  1  -l-fr  "j 

■o  • «  1osm  [  J0(”)(M-1)k  ai?k  ] 


JL-.1+P 


1  l4p 


(A.  9) 


which  for  M=2  is  (2.29). 

For  the  case  of  side  information  available  E^,m\p,Q*)  can  be  calculated 
as  follows 


1  ml+P 


I,0)  (P  >Q*)  -  -  “  ^  M_mp(i,s|x)1+P  j  ^ 


“  m  lo®M  f  L  M  m(L4p)  [  2  (Ps(ll2S)p(s))1/(1'H3)  ] 

\l,s  Lk-0  x;d(x,^)-k  S  J  / 

/  r  m  f  1  1/(1+ 

'  m  10Sm(  E  E  (^)(M-l)k<(s/(M-l))k(l-s)m'kp(s)' 

V,s  lk=0  j 


l/(l+c  )t  1+c 


3 "  - iogM  e  iki(k)(M"i)k[(^)k(i"s)m"k. 


k  ,  |  1/  (1+c  )  j  1+c 

d-s)m-k  l 


(A. 10) 


which  for  M»2  is  (2.30). 

The  cutoff  rate  can  be  easily  evaluated  by  setting  p  *  1.0  in  (A. 9)  and 
(A. 10).  When  side  information  is  not  available  (A. 9)  with  p  *  1.0  becomes 


*o,hw 


M 

I 

k-0 


(”)<M-1)Vn_k)!i 


(A.i: 


which  for  M*2  is  (2.31).  When  side  information  is  available  (A. 10)  with 
p  *1.0  becomes 


(A.i: 


which  for  M*2  is  (2.32). 
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APPENDIX  B 

WORST  CASE  DISTRIBUTION  FOR  PARTIAL-BAND  JAMMING 
In  this  appendix  we  show  that  allowing  the  jammer  to  have  an  arbitrary 
number  of  power  levels  instead  of  just  on  or  off  does  not  change  the  optimal 
jamming  strategy.  Viterbi  and  Jacobs  showed  based  on  an  upper  bound  to 
the  error  probability  that  for  binary  FSK  two  level  is  optimum  with 
diversity.  Here  we  prove  that  two  levels  is  optimum  for  binary  FSK  based 

l 

on  the  exact  bit  error  probability  and  that  two  levels  is  optimal  based  on 
channel  capacity  when  side  information  is  available. 

Let  Z  be  a  nonnegative  random  variable  with  expectation  N  and  distribution 
Fz(z).  If  Z  ■  z  represents  the  jammer  having  noise  level  z  then  the  average 
error  probability  p  is  8 


F  -  EC%  e"*/2Z 


(B.l) 


where  8  is  the  received  energy  of  the  transmitted  signal.  Define  the 
function  f(z)  by 


,-8/2  z 


Z  >  0 


Z  -  0 


This  is  shown  in  Figure  B.l. 

We  will  show  that  f  has  a  single  point  of  inflection 


k  e'<f/2z(E/2z2) 


*  e"<S/2z(i/23)[^-  -  1] 


/2z 

Since  %  e  (-^)  Is  always  nonnegative  die  only  point  of  Inflection 
zJ 

occurs  at  z  ■  E/4.  Furthermore  for  z  <  E/4,  f(z)  Is  a  convex  function 
while  for  z  >  E/4  f(z)  is  a  concave  function.  Define  the  function  f  by 


e^z/E 


0  <  z  <  E/2 


.  z  >  E/2 


This  function  is  shown  in  Figure  A.l.  From  the  above  it  can  be  shown  that 


f (z)  £  f(z) 


z  ^  0 


with  equality  if  z  >  E/2.  We  can  write  (A.l)  as 


P  -  E{f (2)}  <  E[f (Z)} 


with  equality  if  z  >  E/2  or  if  Z  is  conccentrated  at  the  two  endpoints 
i.e.  z  =  0  and  z  ■  E/2.  Now  since  f  is  a  concave  function  we  have 


p  <  E(f(Z))<  f(E(Z))  *  f  (N) 


Equality  can  be  achieved  in  (B.3)  if  z  is  concentrated  on  two  points  or 
less.  Notice  that 


-<?/2N 


<S/N  <  2 


cS/N  s  2 


Thus  we  have  shown  that  two  levels  is  a  worst-case  distribution  for  binary 
FSK  with  error  probability  on  the  performance  measure.  The  capacity 
without  side  information  is  a  decreasing  function  of  the  error  probability 
so  that  two  levels  is  optimum  without  side  information  also. 

With  side  Information  the  capacity  C  is  the  average  of  the  capacities 
of  various  power  levels: 

C  -  E(C(<S/Z)}  . 

Now  instead  of  maximizing  the  error  probability  we  minimize  the  capacity. 
All  the  arguments  for  error  probability  are  true  when  f  is  replaced  by 
C(5/z)  provided  C(<S/z)  *  g(z)  changes  convexity  just  once.  This  is  much 
harder  to  show  for  g  than  for  f  and  will  not  be  done  here. 


Figur 


f(x) 
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APPENDIX  C:  ERROR  PROBABILITY  FOR  REPETITION  CODES 
ON  M-ARY  SYMMETRIC  CHANNELS 

In  this  appendix  we  derive  the  error  probability  for  repetition 
codes  on  an  M-ary  symmetric  channel  (IISC) .  Let  p  be  the  probability 
of  a  symbol  error  on  an  MSC  and  let  q*l-p.  Also  let  X  represent  the 
input  to  the  channel  (X  €  {0,1, . . . ,M-1})  and  Y  the  output.  Then  the 
probability  that  Y*y  given  that  X=x  is  given  by 


P{Y-y|X*x} 


q» 


p/M-1 


x*y 


Assume  the  information  symbol  to  be  transmitted  is  X=0.  The 
repetition  code  sends  this  symbol  n  times.  The  decoder  counts  the  number 
of  times  each  symbol  was  received  and  chooses  the  one  that  had  the 
largest  count,  as  the  transmitted  symbol.  Let  Y^  0  <  i  <  M-l  be  the 
number  of  times  that  i  was  received.  For  n=l  the  symbol  error  probability 
P  (1)  is  just  p;  for  n=»2  the  error  probability  P  (2)  can  be  computed 

G >  S  6 jS 

by  considering  the  probability  of  correct  decision  P  : 


P 

c,s 


(n) 


=  1 


(C.1) 


This  can  be  computed  as 

Pc?s  =  P{Yo*2}  +  *5*^=1,  Yj=1>  sorae  } 

The  first  term  is  the  probability  that  both  symbols  transmitted  were 

? 

received  correctly  and  is  equal  to  (l-p)“.  The  second  term  is  the 


probability  that  a  tie  occurred  which  is  decided  randomly  between  X=0 
and  X*j .  This  is  given  by  h  2(l-p)p  so  that 


1 


! 

1' 


L 


b 


* 


?Ct2  m  ^1_P^2  +  P(1_P)  *  1-p 


(C 


For  n»3  we  have  the  probability  of  correctly  decoding  P  <3)  given  by 

-  c  »s 

pc,s  “  p{Yo  -  2}  +3p{yo“1*  V1’  V1’  i^0, 

-  q3  +  3pq2  +  j  3qp  (-—  P) 

-  q3  +  3pq2  +  (~f)p2q  (C. 

For  n**4  we  have 

_  4.3  .  ,  2  -M-2  ..1-2  p 

Pc,s(4)  "  q  +  P  +  6<1  PC^IJ  P>  +  J  6q  P 


.  1  ,  ,M-2  wM-3  , 

+  4  (iwrp>(ifT|,> 


4  ,  ,  3_  ,  „,M-^  ,  1  2  2  .  (M-2)  (M-3)  3 

q  +  4q  p  +  [6(j^+  3(rrT)]q  p  +  - ^ qp 

1  M  1  (M-1)Z 


(C. 


For  n*5 


Pc,s(5)  "  q5  +  5q4p  +  10q3p2  +  [10(mS)(mS)  +  15  1  q2p3 


(M-l) 


,  (M-2)  (M-3)  (M-4)  4 

+  - o - 

(M-l) J 


(C. 


For  n»6 


69.998825149 


55.717975016 


21.909972461 


0.481708426 


For  any  M  and  n  with  p  =  — rr-  ,  P  (n)  =  (M-l)/M. 

M  e ,  c 

We  can  calculate  an  upper  bound  on  P  (n)  for  any  n  by  applying 

e .  c  ... 

the  union  bound  technique.  This  is  calculated  as  follows: 


P  (n)  <  (M-l)  P^'  (n) 
e ,  s  —  e ,  s 

(?) 

where  P  (n)  is  the  error  probability  between  two  codewords  of  a  repetition 
e ,  s 

code  of  length  n.  This  can  be  shown  to  be  given  by 


3  >k 
j  <  k 
j  +  k  <  n 


,n.  j  _p  k.M-2  .  n-j-k 

9  q  (  k  5  (  p)  . 


X  n,  i.n-i..  p  .  j.M-2  .n-2j 

+  T  9  ’  (  i  ’  W  (ifT  p) 

3*0  J  J 


(C  .8) 


A  simpler  bound  can  be  obtained  by  using  the  Bhattac'naryya  bound  on 

(2) 

P  (n) .  This  bound  is 
e  ,s 


P(2)(n)  r  Dn 
e,s 


(C .  9) 
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